Shulou(Shulou.com)11/24 Report--

CTOnews.com September 20 news, in August this year in 2023 Xiaomi Lei Jun annual speech, Xiaomi AI model was first announced. Compared with the trillions of parameter models of other companies, the Xiaomi AI model does not focus on expanding super-large parameters, but tries to put the 1.3 billion-parameter model to run locally on users' phones.

Recently, Wang Bin, director of Xiaomi Group's AI laboratory and chief scientist of Natural language processing (NLP), revealed their considerations in a lively interview, and said that the future must be the coexistence of large and small models, universal and dedicated.

Wang Bin said that unlike other companies, Xiaomi has a large number of devices, and the computing power of these devices has been greatly improved. For example, the computing power of chips on mobile phones is much higher than before. Second, Xiaomi is an end-to-side company, if you want to use a large number of cloud computing power, the cost is relatively high. In addition, the privacy of users and the network conditions of users when using mobile phones are also our considerations.

However, the small number of parameters of the large model will also affect the user experience, so Xiaomi needs to strike a balance between the size of the model and the hardware threshold.

Wang Bin said: "We believe that in addition to general capabilities, small models with different dimensions may be more suitable for a particular task, so they may end up in the form of a hybrid, both in the cloud, end-to-side, large models and small models." maximize the user experience through a common ecology. "

According to previous reports from CTOnews.com, Lei Jun said in his 2023 speech that Xiaomi had laid out 12 technical areas and 99 subdivided tracks, with a technical investment of 100 billion yuan in the next five years. In terms of AI, Xiaomi has been laying out since July 2016, and a large model team with more than 3000 people was set up in April this year.

At present, Xiao Ai has begun to upgrade the capability of the AI large model, but it has not been opened on a large scale.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.