AI can write articles, paint, and chat—these are no longer novel. But have you ever imagined that AI can also hear dangerous sounds, make classrooms more lively, and even recite ancient poems in dialects?
On the evening of December 29, 2024, at the first 'China Science and Technology Innovation Gala' (abbreviated as 'Science Gala') by China Media Group, iFlytek Chairman Liu Qingfeng used a series of wonderful live demonstrations to show audiences nationwide the innovative practices of artificial intelligence empowering all walks of life, and how AI technology truly enters people's lives and serves social development.
As another key program created by China Media Group after the 'Spring Festival Gala', this science and technology New Year's Eve gala took 'new quality productive forces' as its theme, comprehensively showcasing the major achievements of China's scientific and technological innovation in 2024. As a representative of artificial intelligence enterprises, iFlytek demonstrated its latest artificial intelligence technology application achievements at the gala.
'AI Zhang Tengyue' Shows Off Skills in 3 Dialects in Three Minutes
When a 'second Zhang Tengyue' suddenly appeared on stage, the audience exclaimed in amazement. This AI virtual digital human created byiFlytek Smart Creationnot only interacted and conversed calmly with the real host, but also delivered a wonderful performance spanning languages and dialects.
In the picture, 'AI Zhang Tengyue' (left) and host Zhang Tengyue (right) appear on the same stage
'AI virtual digital human Zhang Tengyue' performed classic poems such as 'Quiet Night Thoughts', 'Looking at the Moon and Thinking of One Far Away', and 'Man Jiang Hong' in Shaanxi, Cantonese, and Henan dialects respectively, with clear articulation and full charm, demonstrating the breakthrough progress made by AI-driven virtual digital human technology in multilingual and multi-dialect expression.
In the picture, 'AI Zhang Tengyue' recites 'Quiet Night Thoughts' in Shaanxi dialect
According to the introduction, AI Zhang Tengyue integrates iFlytek's advanced artificial intelligence technologies such as speech synthesis, speech recognition, semantic understanding, lip shape prediction, and image processing. Through deep learning, it achieves precise restoration of expressions and movements, and with advanced speech synthesis technology, AI Zhang Tengyue possesses natural expressions, smooth movements, and realistic voice performance.
At this year's iFlytek Global 1024 Developer Festival, iFlytek took the lead in releasing the ultra-realistic digital human. With just one photo, a专属形象 can be created, and the mouth shape, expressions, and movements are all automatically generated by the large model, able to precisely match the intent of the text, further lowering the application threshold of virtual digital humans. These technologies can all be experienced in iFlytek Smart Creation.
Currently, iFlytek Smart Creation's video dubbing, news videos, training videos, and advertising videos have also been widely used in multiple fields such as media, finance, smart cultural tourism, enterprise digitalization, smart government affairs, and IP operations, and have established cooperation with units such as Xuexi Qiangguo, Xinhua News Agency, WAIC, China CITIC Bank, and Ping An of China.
Virtual Digital Humans Help Empower Multiple Scenarios
At present, the inclusive dividends brought by technological progress are gradually emerging. Virtual digital humans are beginning to unlock more and more industry application scenarios.
iFLYTEK's multi-scenario virtual digital humans + large models empower multiple fields. From the international event the Paris Olympics to the intangible cultural heritage Beijing Central Axis, from the industry event the Tianjin Smart Expo to the smart exhibition hall Shandong High-Speed, virtual digital humans are playing an increasingly important role. They can not only carry out product introductions and customer service, but also provide more precise and personalized service experiences based on big data and artificial intelligence technology. Currently, platform-based products represented by the AI virtual human interaction platform have been successfully implemented in multiple industry fields such as central state-owned enterprises (enterprise digitalization), education and training, cultural tourism, e-commerce, and financial services, and the breadth and depth of their applications are continuing to expand. This achievement is a vivid portrayal of iFLYTEK's virtual digital humans deeply engaging in industrial practice.
As a representative of new quality productive forces, the virtual human platform has always adhered to practicing AI+, and is committed to making virtual humans become human partners!