Shulou(Shulou.com)11/24 Report--

At present, with the popularity of large model technology, how to build high-performance networks and provide large computing power support for large models has become a difficult problem to solve large model technology. Du Xiaoman actively laid out the cutting-edge technology of large models, constantly solved the technical problems of large models, and jointly launched the White Paper on Network Architecture of Intelligent Computing Center with Baidu Intelligent Cloud to provide full-process guidance for high-performance network construction.

Layout large model frontier science and technology degree small full construction private cloud intelligent computing network

On September 5, at Baidu Cloud Intelligence Conference, Baidu Intelligent Cloud Joint Degree Xiaoman launched the White Paper on Network Architecture of Intelligent Computing Center. The white paper was written by Baidu Intelligent Cloud and Du Xiaoman, a front-line expert responsible for the implementation of high-performance network. The content covers all aspects of high-performance network construction, including architecture selection of clusters of different scales, construction of visual operation and maintenance tools on cloud platforms, operation scheme design of multi-tenant, etc., providing full-process guidance for peers and making complex high-performance network construction simple.

Large models require large computing power, and how to build high-performance networks is the most critical step. In May this year, Du Xiaoman officially opened the first 100 billion parameter financial model in China-"Xuanyuan." In the task evaluation in the financial scenario, Xuanyuan comprehensively surpassed the mainstream open source large model in the market, winning 63.33% of the 150 answers. With the rapid development of large models, the demand for low-level computing power of models increases exponentially, and the continuous expansion of intelligent computing power brings about the increasing expansion of GPU computing deployment scale and the increasing requirements for high-performance networks.

Degree Xiaoman Intelligent Computing Network Center reaches the scale of ten thousand calories

With the parameter scale of Du Xiaoman model exceeding 100 billion yuan, in order to meet the increasing computing power demand, the intelligent computing center of Du Xiaoman private cloud mode is also constantly upgrading. The large-scale intelligent computing network with low latency, large bandwidth, stable operation and high operability is an important cornerstone for the intelligent computing center. In the process of building the intelligent computing center of private cloud mode, Du Xiaoman and Baidu intelligent cloud have built a set of private cloud intelligent computing network. While supporting the scale of 10,000 cards GPU, compared with the common Dragonfly and Tours network topologies in the industry, the network bandwidth is more sufficient, the number of hops between nodes is more stable, the network delay index is shortened to less than 3 microseconds, and it has end-to-end observability and fault self-healing ability. It has no blocking, low delay, The highly reliable network design effectively supports the rapid iteration and development of the upper intelligent computing application, and provides a stable network guarantee for the training of the "Xuanyuan" large model.

At present, Du Xiaoman Intelligent Computing Network Center has been built into the first batch of ten thousand card scale intelligent computing centers under private cloud mode in domestic financial industry, providing stable network guarantee for the training of "Xuanyuan" large model.

Du Xiaoman continues to lay out in the field of large model technology, providing technical support for the innovation and development of the financial industry through innovative cutting-edge science and technology. The launch of the White Paper on Network Architecture of Intelligent Computing Center will provide strong support for overcoming technical problems in the industry. Du Xiaoman will also continue to accelerate the innovation of large model technology, improve the efficiency of financial industry through intelligent analysis and intelligent customer service, and further promote the transformation and upgrading of the industry.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.