Shulou(Shulou.com)11/24 Report--

Thanks to CTOnews.com netizen for intron lead delivery! CTOnews.com April 11 news, China Academy of Information Technology previously set up a large model working group, absorbing more than 60 member units, covering large model head enterprises, Internet enterprises, scientific research institutes, telecommunications operators, financial institutions, etc., around technical discussions, industrial exchanges, standard development, evaluation testing, case collection and other aspects of work.

More than 60 units of the joint working group of the Chinese Academy of Information Technology have jointly developed a series of standards for large-scale pre-training model technology and application evaluation methods, including four important parts: model development, model capability, model application and credibility requirements. At present, two standards of model development and model capability have been issued. The model development standard includes 4 capability domains, 16 capability subdomains and more than 60 capability items, including data construction, model training, model management and model deployment, comprehensively evaluating the ability of research subjects to develop large models.

The model capability standard includes three evaluation dimensions: function richness, performance superiority and service maturity, 8 capability domains and more than 30 capability items, which comprehensively evaluate various technical capabilities of the large model. The model application standard is preliminarily finalized, including 3 capability domains, 14 capability subdomains and more than 30 capability items of application richness, service maturity and operation management capability, and comprehensively evaluates the application maturity of the large model. Credibility requirements standards are under preliminary study and will be developed in the near future.

CTOnews.com learned from the official that the large model of "Zidong Taichu" developed by Institute of Automation of Chinese Academy of Sciences and Wuhan Institute of Artificial Intelligence participated in credible AI evaluation from February 12 to March 3. The model development and model capability obtained 4 + grades, becoming the first academic institution in China to pass this evaluation.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.