Shulou(Shulou.com)11/24 Report--

"Hello, everyone. I am a digital magnate, and I am honored to be able to discuss with you a topic of great concern: can AIGC (AIGC, AI Generated Content, which refers to the use of artificial intelligence technology to generate content) be able to create instead of human beings? History has proved that human creativity and creative style are constantly evolving with the times and technological innovation. In content creation, especially in the creation of high-quality personalized content, AIGC and human collaboration is a very necessary part. "

Yao Tianheng, deputy general manager of Tencent's content platform department, made such a speech through his digital man "tycoon" at the 2023 new list conference on March 30. What makes people pay attention is that this digital man is not only highly realistic in image, but also very real in pronunciation, intonation, lip movement and so on. Even Yao Tianheng's usual expressions and movements are not carelessly simulated.

Yao Tianheng, deputy general manager of Tencent content platform Department, and his digital man "tycoon"

It is understood that the digital man "tycoon" is based on Yao Tianheng as the prototype, using Tencent Zhiying's latest artificial intelligence technology, through in-depth learning of his own small amount of real audio and video data generated by the split model. Taking this opportunity, Tencent also officially released a new AI intelligent creation assistant, Tencent Zhiying, which provides content creators with a series of intelligent creative tools to help creators improve quality and efficiency in content creation.

In content creation, the industrial scale output of PGC and the creative transformation of UGC have always been the core problems troubling creators, but the development of AIGC has greatly improved the production efficiency of creators, thus providing a feasible solution to the above problems. With the combination of AI capabilities and human creativity, AIGC can achieve full-link closed-loop human-computer cooperation, including content creativity, opinion establishment, material generation, content retouching and production. Tencent Zhiying makes content creation more simple and efficient by providing the ability of 'people', 'sound' and 'shadow'. " Yao Tianheng introduced.

Liberating the power of "people", Tencent Zhiying allows everyone to realize the freedom of digital people.

In terms of "people", "Zhiying Digital Man" is the core function of Tencent Zhiying. Users only need to enter text or audio content to generate digital human broadcast video in a few minutes. Tencent Zhiying currently offers dozens of digital people with multiple styles. Creators can choose digital human images and clothes according to their own needs, and add different actions and backgrounds to make live-action video production easier.

Tencent Zhiying Digital Man broadcast

In addition, Zhiying digital people can also achieve "image cloning". Similar to the digital man "tycoon" at the beginning of the article, users can get their own digital man by uploading a small number of pictures and video materials, and the price is easy to operate, so that everyone can realize the freedom of digital man.

Tencent Zhiying also connects to live streaming of digital people, which can directly replace real people without time and space restrictions, no need to build any shooting venue, and can use virtual backgrounds for broadcasting, interviews, connection, interaction and other operations, to achieve uninterrupted broadcasting 24 hours a day.

Live broadcast of Tencent Zhiying Digital Man

At present, Zhiying digital people are used in many scenes. Not long ago, Tencent Zhiying provided technical support for the coverage of digital anchor Ren Xiaorong at the two sessions of the new media, bringing personalized news broadcast content of "thousands of people and thousands of faces". During the epidemic last year, Tencent Zhiying also worked with the Voice of the Yangtze River Delta of Shanghai people's Broadcasting Station to create the country's first provincial radio digital anchor "Changxiaojiao", helping to explore the transformation of media content production and video. In addition, adhering to the concept of Tencent Tech for Good, Zhiying sign language digital person also serves the Winter Olympic Games and Arena of Valor KPL competitions, reporting and commenting on events for the hearing impaired.

Blooming "sound" machine, Tencent Zhiying helps creators dubbing to become efficient and concise

In the innovation of AIGC in the direction of sound creation, Yao Tianheng introduced the three major functions of Zhiying text dubbing, timbre customization and intelligent voice change.

In order to meet the dubbing needs of different creators, Tencent Zhiying text dubbing feature provides hundreds of timbre to choose from. Input text can generate natural voice, which is simple and convenient to operate. It is suitable for news broadcasting, short video creation, and audio novel scenes. The data show that a 1000-word manuscript can be dubbed and released by Tencent Zhiying within 2 minutes. at the same time, it can manually adjust the effects of voice doubling, local speed change, multi-tone words and pause, and support multi-emotion and dialect broadcasting. Make the audio sound more vivid and natural.

Tencent Zhiying text dubbing

In addition, based on Tencent Zhiying's voice recognition and reproduction technology, creators can quickly edit audio and video content. First of all, Tencent Zhiying can automatically remove redundant words through speech recognition and text smoothness; in audio rewriting, some sentences in the original video can be modified through technologies such as voice cloning and audio training. Yao Tianheng said, "this way of converting text to voice can reduce the tedious recording process, and help creators complete a large amount of dubbing work quickly and accurately in scenarios such as video creation, hot posting, book renovation, and post-slip of tongue handling." let high-quality content reach the audience more quickly. "

Tencent Zhiying also provides an interesting voice-changing feature. Through Tencent Zhiying's voice-changing technology, creators can convert audio into a designated voice while retaining the original rhythm, helping creators liberate productivity and make video more expressive. In the live demonstration, Yao Tianheng took the voiceover of "three-body" Ye Wenjie as an example. Tencent Zhiying reengraved Ye Wenjie's timbre in advance and converted the voice recorded by any person into Ye Wenjie's timbre through Zhiying's voice-changing technology, which sounds very contagious. " In the face of a large number of content production tasks, the creation team can work together to help KOL perform audio interpretation, or in the video processing, a video needs to be re-recorded and modified, through this function, there is no need for actors to rework, any staff can help complete dubbing updates. "

Let the "shadow" follow, and Tencent Zhiying makes the automatic generation of intelligent video a reality.

In terms of creating AI for video clips, Yao Tianheng pointed out that AIGC's automatic text generation video technology is a revolutionary technological innovation that has brought unprecedented opportunities and challenges to the video industry. Compared with traditional video production methods, AIGC technology not only greatly improves the production efficiency and quality of video content, but also provides creators with more creative space and freedom.

What kind of intelligence is valuable to the creator? Yao Tianheng gave three key words: "know you better", "more beautiful" and "more vivid".

"know you better" means that a good tool must accurately understand the creator's intention, whether it is text, voice or hand-drawn sketches, can be quickly transformed into actual creative results by intelligent tools. " "more exquisite" refers to the improvement of creative quality, such as good intelligent tools to help creators tell their stories better through various forms of assistance, such as a good sentence, a beautiful picture or a wonderful shot. " "more vivid" is the requirement for the form of content expression. Video is a more vivid form of expression than pictures and text, and good tools can help creators produce more interesting and vivid content.

With the blessing of AIGC technology, creators can convert their own text into video content directly through the video conversion capability of Tencent Zhiying articles, without the need for tedious material collection and processing. In addition, the segmented material presentation of Tencent Zhiying allows creators to quickly deal with split lenses, add card points, filters, special effects, etc., thus greatly shortening the cycle and cost of video production. At the same time, Tencent Zhiying also provides a large amount of copyright materials to provide creators with more choices and inspiration. This enables creators to focus more on creative planning, creativity and marketing, and improve the quality of content and communication effect.

Tencent Zhiying article to video

"in the future, Tencent Zhiying will become more intelligent, and creators can even create an animation or make a wonderful video on Zhiying with an idea to make their stories more vivid." For the next step of the development plan, Yao Tianheng said that Tencent Zhiying will further strengthen the research and exploration of AIGC technology, constantly tap its potential application value and possibility, lower the threshold for the use of products such as digital people and voice customization in terms of price and ease of use, and use AI to empower creators, so that intelligent creation can be accompanied by shadow, truly realize the diversity of content, and let creativity bloom.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.