Shulou(Shulou.com)06/02 Report--

On October 17th, the 10th China system Architects Conference, with the theme of "Ten-year Architecture, the Road to growth", was held at Four Points by Sheraton Curitiba, Haidian, Beijing. The conference gathered more than 1,000 technical people, such as domestic CTO, R & D director, senior system architect, development engineer and IT manager. Three days of traditional technology conference speech, two days of in-depth theme training, SACC ten years of honing, Nirvana set sail!

In the next morning, infrastructure design: cloud architecture and CDN acceleration topics, welcomed four heavyweight guests, they are iqiyi scientist Zheng Shuxin, Alibaba senior SA Duan Jigang, Tencent Music Entertainment Group Group Senior engineer Duan Jigang, Sina.com system development technology expert Li Xiaodong, they share technology from various angles, the special venue is full of participants!

Service Management of Zheng Shuxin-iqiyi CDN system

Iqiyi scientist Zheng Shuxin

Zheng Shuxin is currently a scientist at iqiyi, mainly engaged in the infrastructure of iqiyi's CDN system, with the ability to design and develop large-scale systems, and is good at high-performance network communication and server architecture design.

Iqiyi CDN system is a huge and complex network, carrying iqiyi video data distribution, origin-pull and other core business. Iqiyi CDN nodes throughout the country, a large number of servers, how to effectively manage and maintain many application service modules deployed on these servers is a huge challenge Iqiyi CDN team developed a set of service management platform based on Acl server framework, and achieved good results in practice, such as: real-time monitoring of core service modules, early warning of service operation problems, module resource control and so on. This paper introduces the engineering practice of iqiyi CDN system based on Acl server framework from the point of view of service management. The main contents are as follows:

1. Characteristics of Acl server framework

two。 Introduction of iqiyi's service-oriented platform

3. Application Services running on the Service Management platform in iqiyi CDN system

4. The value of iqiyi service platform in production.

Duan Jigang-Alibaba OPSX-Making open source closer and easier

Alibaba senior SA Duan Jigang

As a senior SA of Alibaba, an expert in cloud product operation and maintenance, Duan Jigang has been responsible for the operation and maintenance of e-commerce cloud platform "Jishi Tower" since 2012, and is the author of "Design and implementation of linux Software Management platform". He shared from three aspects. first, he introduced Alibaba open source mirror station. Aliyun provides software installation and upgrade services for global ECS users, as well as OS download and software installation services for Internet users.

Then we share the technical architecture of Alibaba open source mirror station. For cloud users, private network unitalization and caching mechanism, architecture optimization to reduce synchronization and origin-pull. For Internet users: CDN acceleration provides the fastest system in the city & software installation service. In order to improve the user experience, a series of work has been done, including advanced search and hot warehouse assurance.

Finally, it shares the Kaiyuan ecological construction based on the mirror station, and plans to provide the ecological chain construction of "code hosting-open documents-automatic construction-content distribution-technology exchange-youth open source software alliance construction". Duan Jigang said that so far we have achieved 1) open source hosting 2) document center 3) Git automatic construction service 4) private software warehouse, the next stage we will hold open source technology salon and component youth open source software alliance to encourage college students and young people to participate in China's open source ecological construction. "

Chen Wenwu: the practice of high availability of national singing live message service

Chen Wenwu, Senior engineer of Tencent Music Entertainment Group Group

Chen Wenwu, who graduated in 2014 and joined Tencent, participated in the development of national singing from zero, mainly engaged in the construction and optimization of massive background service architecture, as the person in charge of core basic services such as accompaniment information service, UGC work dynamic service, virtual gift system, live message service and so on.

National singing as a product of Tencent's Hall of Fame, the DAU reaches more than 5kw, and live broadcasting is the main business of national singing. The news in the live broadcast affects the audience's perception and interaction with the VJ, and directly affects the revenue of the project. Each failure will bring great losses. Chen Wenwu said that we have built a high availability system to support the entire service, with tens of billions of requests per day. We mainly introduce the high availability of services from many aspects, such as basic network facilities, network access layer, business logic layer, storage layer and so on. It will focus on the service isolation design scheme, flow control strategy, multi-location reading and disaster tolerance scheme, write disaster recovery scheme of double parks in the same city, and overload protection scheme. And three-dimensional monitoring indicators to solve five difficult problems in the process of realization.

The five major problems include, 1. Hot issues, a large number of popular live streaming viewers and a large number of messages spread to bring huge bandwidth and load pressure; 2. Low latency, poor tolerance of interactive message delay, need to send and receive messages as quickly as possible to complete the interaction; 3. Message arrival rate, key messages (gifts, signaling) require reliable access, and many key operations rely on messages for synchronization

4. Uncertainty, peaks caused by interaction, such as the sudden increase in online population and traffic caused by anchor competition, gift packages, operational activities, etc.; 5. Multi-location disaster recovery, multi-location access challenges to traffic and delay.

Li Xiaodong: the actual combat of CDN multi-cloud scheduling system in the scene of VOD live broadcast.

Li Xiaodong has nearly 15 years of R & D and operation and maintenance experience in the fields of data center infrastructure, traffic access and scheduling, CDN, system optimization, etc. During his time at Sina, he was in charge of network equipment research and development, automated operation and maintenance, operating system and kernel optimization, CDN research and development, cloud storage, traffic access and other teams; and served as the team leader of Letv Cloud CDN scheduling system, and actually operated a 10 Tbps+ scheduling system.

Taking the four typical scenarios of "popular movies and TV dramas, short videos, live events and UGC/PGC live streaming" as an example, this paper deeply analyzes how to design a scheduling system to realize the elastic allocation of massive bandwidth among multiple CDN cloud vendors (including self-developed CDN), and help to achieve a high-quality, low-stutter and low-cost playback experience. At the same time, the application of machine learning in CDN scheduling system will also be discussed.

Li Xiaodong said that an omni-directional perspective is conducted from four different perspectives: end users, CDN cloud vendors, CDN cloud customers and self-developed CDN. At the same time, the technical experience of live broadcast of Sina, Weibo, top 12 / AFC / Premier League / Chinese Super League and serving many CDN business customers is integrated.

For more wonderful information about the conference for the first time, welcome to the conference topic: http://zt.it168.com/topic/sacc2018/

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.