Shulou(Shulou.com)06/01 Report--

"not any cloud can support this traffic. There are two clouds in China, one is Ali Cloud and the other is called other Cloud." On the evening of November 11, Zhang Jianfeng, CTO of Alibaba Group, said, "Aliyun is different. We wrote the first line of code 10 years ago to build China's only self-developed cloud operating system, Feitian."

Zhang Jianfeng, CTO of Alibaba Group and Zhang Jianfeng, president of Aliyun Intelligence, 2019 Tmall double 11 once again set a new world record, with a peak of order innovation of 544000 per second and a daily data processing capacity of 970PB. This year, Alibaba's core system is 100% on the cloud, supporting the world-class traffic peak of double 11. "Alibaba is a plane flying at high speed, and we have successfully replaced it with a brand new engine in the process." Zhang Jianfeng said that Aliyun was the first to use the public cloud to host such a trillion-scale core system. "many cloud manufacturers' own business systems are not on their own clouds, and all Ali's systems will be on Aliyun in the future." Alibaba is the first large Internet company in the world to run 100% of its core systems on the public cloud. PS: the core point of Zhang Jianfeng's speech began last year, we decided to put the entire Alibaba core system on the cloud, Shangyun also added an attribute, is on the "Ali cloud", not any cloud can support this traffic. In China, we often say that there are two clouds in China, one is called Ali Cloud, and the other is called other Cloud. Why is Aliyun different from other clouds? Because in China, only Aliyun is a cloud completely developed from scratch, starting with every line of code, written ten years ago, and this year is the 10th year of Aliyun, so our cloud has a special name, called "Feitian operating system." when Dr. Wang Jian founded Aliyun, the scheduling system under our cloud, the basic platform of the entire cloud, was named "Feitian operating system." Our cloud is completely a cloud developed by China, and many other clouds have been transformed from open source software, which is very different. Second, this year's Singles' Day, Ali is still a plane flying at high speed, and we have successfully replaced it with a brand new engine in the process. In the past, people put non-core loads on the cloud, but now Alibaba's core system is on the cloud. Now our cloud turns the original dedicated technology into a public cloud, and everyone can enjoy inclusive services. We have the best system, and you can use it like us on it. Aliyun carries Alibaba's own 100% core system, which is the first one in the world. Many cloud vendors have their own business systems, but their own systems are not on their own clouds. All of our future Ali systems are on Aliyun's Flying Apsaras operating system. You must think, is this a simple replacement or a very big technical progress, a very big challenge? Let me briefly say that we have done very well in several aspects, it is not a simple replacement, there has been a very big improvement in performance after going to the cloud.

Today, you may have a feeling that in the first ten minutes, consumers basically didn't feel any jitter, and everyone went shopping very smoothly. First, we develop the dragon architecture on the core virtual machine system, and use the self-developed server to do virtualization. The average server will gradually decrease its load capacity as the pressure increases, and it is not linear. The greater the pressure on our Dragon server, the output is also very linear, which is very difficult to do. Second, we have developed our own cloud native database. This year, there are two databases, one is self-developed OceanBase, we all know that we have won the first place in the world in the TPC-C test. The second is PolarDB, which is also widely used in double 11 this time. There is no problem, and our peak per second is far beyond the traditional database like Oracle.

Third, our calculation and storage have been separated. Now Alibaba Storage has a special place to store data. Data is accessed remotely, so storage can be easily expanded because it has a dedicated pool. I couldn't do it. Because of the original remote storage, the speed of accessing the network can not keep up. Fourth, the reason why we can now store remotely and read and write disks faster than local disks is because we have made RDMA networks, which is the first company in the world to do RDMA networks on a large scale. We have made core breakthroughs in these four areas. Today, the Feitian operating system can schedule more than 100000 servers. There are a lot of applications in double 11 today, but it doesn't mean that all application loads are the same at every point in time. We allocate most of the computer resources to applications such as transactions at zero, and after a little bit, we allocate the data to the data processing system. Data processing has reached a new high this year, processing 300PB data in 2017, 600PB data in 2018, and about 970p this year. You may have no idea how much data a P has. The last time I communicated with the people of CCTV, CCTV filmed TV news programs for so many years, and he saved about 80p data over the past few decades. Double 11 one day, we have to deal with 970p data, a very large amount, without an advanced system is not sustainable. The second is very real-time, as you can see, today in the second kill, in the venue are all personalized, thousands of people, the data here is not only large, but also to achieve very real-time. So far, our Cainiao logistics system has generated more than 1 billion logistics orders, and this figure is still rising rapidly, which depends on a lot of computing power behind Aliyun. Our data this year, in addition to batch processing, there is also stream processing, that is, all the data are processed in real time, just as you can see that the transaction data is changing every minute and every second, and it is not counted from the database. It is that every time an order is generated, the system automatically collects the data layer by layer. Our system can handle 2.5 billion records per second. This is a streaming system. We have so many servers that if we want to manage all of them, we also have to manage all the message flows in addition to the Flying system, so we have developed a messaging system called MQ, which is also the largest messaging system in the world. Today, from Feitian system, big data processing platform to intelligent applications, these technologies add up to create a new distributed cloud-based platform, so that all the core applications of Ali's entire economy can run on it. Finally, we released a self-developed chip containing 800 light this year. Next year's double 11, Ali a large number of artificial intelligence applications will run on the self-developed chip. Today, from Feitian Cloud operating system to Shenlong server, database, switch, switch operating system, RDMA network, all are self-developed by Ali. Today, we have accumulated very rich and strong capabilities, from hardware, database, cloud computing operating system, to the above core application platform, four-in-one, this is the biggest difference between Singles' Day and previous years.

* * all unthinkable will eventually become ordinary; we believe that "believe", everything is new. Happy double 11! **

The original link to this article is the original content of Yunqi community and may not be reproduced without permission.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.