Shulou(Shulou.com)11/24 Report--

The 19th Hangzhou Asian Games ended yesterday. After 16 days of fierce competition, more than 10,000 athletes fought tenaciously on the field, pursued excellence, had friendly exchanges and enhanced friendship off the field, and set records for super or even competitions, Asian records and world records for more than 200 events, interpreting the Olympic motto of "faster, higher, stronger-more United". The creative team of the closing ceremony last night created the "most beautiful garden" on the "CNC lawn" through the most advanced light and shadow technology, and left precious "memories of the Hangzhou Asian Games" for people all over the world by holding a relaxed and happy party. The stunning "Digital Torch Man" returned again to pay tribute to the audience, witnessing that after the Asian Games sacred flame was slowly extinguished, the Digital Torch Man bid farewell to everyone and finally ran into the night sky, turning into stars.

Official picture: digital torch people pay tribute to each other

It is understood that the "Digital Torchbearer" event initiated by the Hangzhou Sub-Organizing Committee, with a total number of participants exceeding 100 million, set a new Guinness World record on September 15, making it the largest online sports promotion event in history.

In this Asian Games, in addition to the splendid competitions, a number of cutting-edge technologies, including digital people, have also appeared on the bank of the West Lake and stepped into the eyes of the world. Countless spectators across the space barrier enthusiastically cheered for the game, online live broadcast to watch the game, online joint broadcasting cheering has also become a different kind of watching experience.

Recently, SkyTek has increased the size of real-time interaction to 10,000 real-time interactions, providing more games and possibilities for online live streaming. The platform can set routing rules at will: pull audio streams that are interested and valuable to you, so that all signaling generated by users in a room of 10,000 people is accurate and not lost, and real real-time interaction between 10,000 people becomes a reality.

As early as 2017, it first launched a video call joint broadcasting technology that supports 32 people's real-time interaction, which realized multi-person real-time scene calls one year earlier than Apple's FaceTime. But up to now, in the perception of most users, the overall level of support for broadcasting interaction has not improved significantly.

Why is the growth of online population supported by real-time joint broadcasting in the industry slow? Currently, online communication scenarios with small-scale interaction account for the majority, so what are the application scenarios for pursuing the scale of joint broadcasting users in real time?

01 where does large-scale joint broadcasting reflect the value?

At the opening ceremony of the 19th Hangzhou Asian Games, digital people, virtual fireworks and other technical capabilities have been fully demonstrated. We might as well imagine that XR equipment has been completely rolled out in the consumer market at the 20th and 21st Asian Games. In addition to the athletes and spectators who are in the host place, the audience can also instantly "place themselves" in the event scene and feel the elegant demeanor of the Asian Games through the virtual space. At that time, if the joint broadcasting capability remained at a level that could only pull 20 to 50 other users' audio streams at the same time, it would probably be difficult for everyone to achieve the exciting experience of cheering in the same place.

In online meetings, live broadcasts and other scenarios referenced by existing examples, large-scale joint broadcasting can expand the scale of interaction, upgrade from department meetings to company and group meetings, and enable scenarios such as watching football and movies together. From a small online salon for dozens of people to a super-large online interactive club, we can share excitement and joy with more people in real time.

Not only that, the emergence of large-scale joint broadcasting technology will also become the infrastructure capability of large-scale real-time interaction in meta-universe. In RPG-like online games, it is not uncommon for hundreds of players to appear on the same screen with the same scene. In an era when interaction between players only supports IM messages and world speakers, the interaction between players is far from being immersed.

The emergence of large-scale joint broadcasting makes it possible for every user in the virtual space to communicate freely and speak freely.

02 Why is it difficult to break through the number of joint broadcasting users in real time?

The first is to consider the cost of traffic. To realize multi-person real-time joint broadcasting in the original technology path is that each user pulls the audio and video stream of all other online users at the same time. Take 100 people as an example, even if they only use voice joint broadcasting, according to the common specification of 16kbps in the meeting scenario, the 1000-minute traffic consumption of 100 people in real-time voice joint broadcasting is close to 1.2TB, and the traffic consumption is not all the cost of audio / video communication.

Secondly, pulling dozens of audio and video streams at the same time is a challenge to the performance of client equipment. The real-time meeting through the mobile device is originally the advantage of the online conference platform engraved in the gene, but at the same time, the limited computing power of the mobile device has also become a bottleneck to limit the increase of the number of concurrency.

Third, when we really think deeply about the use of multi-person real-time joint broadcasting, we can find that it is not realistic for 10000 people to speak at the same time, nor can it form an effective exchange of information. A more practical scenario is that a small number of people are discussing and more people are listening and speaking at the right time.

What large-scale joint broadcasting really brings to everyone is the right to speak and be heard at any time. In a large-scale online joint broadcasting communication, not only the performance of client devices is tested, but also the key technologies of service providers, such as node resource allocation, load balancing, capacity expansion and network connectivity, are going through a big test. The traditional audio and video cloud service architecture is difficult to support.

03 how to break through the limitation and easily realize the real-time interaction of ten thousand people?

As mentioned earlier, the operation of pulling audio and video streams on the scale of 10,000 people at the same time is unwise in terms of cost and client performance. therefore, for pure online and virtual space scenarios, we have launched two cloud intelligent routing strategies: dynamic voice activity monitoring and dynamic user interest range. It can help platform customers solve the challenges of high cost, user-end device performance and cloud service node resource allocation faced by ten thousand people real-time interaction.

Dynamic voice activity monitoring can monitor the voice activity of all users, pull the x bars with the highest voice activity (x can be customized) audio and video streams to the client, and update them in real time with the change of activity. save traffic and ensure effective communication at the same time.

Based on the user's real-time location and AOI (Area of Interest) in the virtual space, the dynamic user's range of interest can be pulled to the user's end from the nearest x bar within the user's AOI (x can be customized). At the same time, with the help of spatial audio ability, the sense of direction can be realized, the sense of direction before and after the sound can be realized, and the auditory feeling in the real world can be restored, making the sound quality experience more immersive.

Through the intelligent routing strategy such as voice activity-user interest range, the massive traffic consumption caused by pulling all audio streams in the room (area) can be avoided in large-scale real-time interaction scenes. at the same time, it can screen and pull a certain amount of user audio to ensure the atmosphere experience and reduce the performance burden of the client machine.

In addition to routing through a preset voice activity / user interest range, that is, the structure has realized that all signaling generated by users in a room of 10,000 people is accurate or not lost. Users or platforms can set routing rules at will through rich information: pull audio streams that are interested and valuable to themselves, and achieve real real-time interaction among ten thousand people.

For the test of ultra-high concurrency in a single room to cloud services, that is, with self-developed massive ordered data network MSDN, Architectural Technology covers 212 countries and regions around the world, achieving a global high-quality intelligent scheduling system to ensure that users can use the optimal nodes at any time and place, and easily deal with large concurrency scenarios with stateless distributed, multi-center and multi-tier audio and video service architecture.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.