Shulou(Shulou.com)11/24 Report--

Tencent Multimedia Lab demonstrated its cutting-edge light and shadow refurbishment technology at the recent 2023 Tencent Science WE Conference, focusing on repairing videos of Andre Heim's early research. This technology uses high-definition restoration technology to give the audience an immersive taste of the magic of science.

This technical practice benefits from the deep accumulation of Tencent Multimedia Lab in the field of video processing over the years. They have developed a variety of restoration techniques for old images, including de-distortion generation, super division, detail enhancement and color enhancement, which greatly improve the subjective quality of video.

In the ultra-clear repaired version, the noise of the experimental subject is removed and the edge is clearly visible.

Tencent Multimedia Lab, which specializes in multimedia technology, includes audio and video coding and decoding, network transmission and real-time communication. At the same time, it also has profound technical accumulation in the field of old film restoration. They have participated in the color restoration of "National Day military Parade", "July 1 Hong Kong return" HD restoration, Zhang Guorong "Love" concert, as well as "Kangxi Dynasty", "families under the World" and other classic film and television drama HD restoration work, showing a wealth of experience in the restoration of historical images.

The restoration of Andre Heim's early research video is not only a technical challenge, but also an immersive viewing experience for the audience. Xia Zhen, an expert researcher at Tencent Multimedia Lab, and his team have set strict standards, hoping that the restored video will give viewers a new sense of immersion.

The light and shadow refurbishment repair engine is the key to this restoration work. It covers the modules of intelligent analysis, picture quality restoration, picture quality enhancement and intelligent coding. It uses a variety of intelligent algorithms to repair the main factors that destroy the picture quality, and improve the clarity and color richness of the picture.

The super-large video size of this repaired video can be played live with high quality and fluency on the big screen, and there is another super technology behind it: video codec. This is a technology that is easy to be ignored, but it is the key technology that leads and drives the development of audio and video technology. The problems it solves can be summed up in one sentence: without changing the subjective quality of the video, compress the size of the video to play it more smoothly and with high quality on all platforms.

The development of ultra-high definition technology has greatly improved the clarity of video, but at the same time, it has also doubled the file size. The original video before compression occupies a lot of storage space, although the resolution is 480p, but the bit rate is as high as 50m / s. If the repaired 4K HD version is output at a high bit rate, it will occupy the storage space of 300GB.

At this point, we have to mention a "trump card technology" in the laboratory: a new generation of international codec standards. It has attracted wide attention in the industry.

The standard was officially released in July 2020 and has become a cross-era milestone for the video industry. compared with the previous generation standard, its compression performance is significantly improved, and the data size can be reduced by 50% while the subjective quality of video remains the same. greatly reduce the traffic and bandwidth costs brought about by video transmission, and promote the evolution of the entire video industry.

Tencent Multimedia Lab is one of the main contributors to the development of this standard, and the technical proposals submitted have been adopted by international and domestic standards, leading the world in quantity. At the same time, laboratory experts also hold important positions in the standards organization, including co-editors of the new generation of international codec standards and co-chairs of reference software. Tencent is one of the first companies in China to participate in and devote to the development of video information compression and decoding standards, and now it is in a leading position in the world in video codec technology.

In the 2023 MSU World Video Encoder Competition, the latest generation of H.266 / VVC encoders developed by Tencent stand out in this highly competitive MSU FullHD coding competition because of its excellent compression performance and bandwidth-saving ability. In the three speed gears of 1fps, 5fps and 30fps, Tencent266 won 12 firsts out of 15 key indicators, and the first total was the most in the whole game. Tencent266 also achieved the first of all 15 indicators in all three speed gears of all VVC encoders. In addition, Tencent266 continues to lead the industry in the MSU World Video Encoder Competition 10bit coding Competition, 4K coding Competition and subjective coding Competition, all of which have won the largest number of first totals in the audience, proving that Tencent266 can bring better picture quality to users with lower bandwidth in different application scenarios.

At the same time, Tencent Cloud audio / video transcoding and related media processing applications have fully supported the new generation of international codec standard in July 2021, which is the first time that the standard has been used in the cloud, filling in the gap of global cloud manufacturers in this field. Tencent266 launched Tencent Cloud LVB in early 23, and Tencent Cloud became the first cloud vendor in the industry to support VVC LVB.

In addition, only three months after the standard deadline, Tencent Multimedia Lab released a new generation of international codec player, which is about 20 times faster than the standard reference software, and can decode UHD images in real time, and its performance is in the leading position in the world.

In recent years, with the development of 5G, artificial intelligence and other digital technology, ultra-high-definition video technology has become an important driving force to promote the rapid development of ultra-high-definition video industry in China. However, in the UHD content production side, there are some pain points such as high cost and low efficiency of UHD content production, classic films and video to HD, which become the key factors restricting the development of the industry.

Xia Zhen said that there are many classic images around the world, such as concerts, TV dramas, movies, documentaries, and so on. Tencent Multimedia Lab has formed a relatively complete matrix of intelligent old film restoration technology. In the future, through the ultra-clear immersion repair engine, we hope to help more classic times reappear in front of the audience with high quality and efficiency.

This restoration work shows the great potential of ultra-clear repair technology in video content repair and conversion. Through this technology, Tencent Multimedia Lab hopes to help more classic works reappear in front of the audience in a high-quality and efficient way, and is also committed to promoting the application of multimedia technology in various industrial fields.

This innovation demonstrates the value of Tencent technology in the field of traditional cultural inheritance and digitization, and makes new contributions to Tech for Good and sustainable social value innovation.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.