Shulou(Shulou.com)11/24 Report--

In recent years, large model technology has gradually penetrated into all major fields of finance, which has injected vitality into improving the efficiency of financial services and promoting the reform and innovation of the financial industry. Lesser Fullness of Grain actively laid out the big model, promoted the landing of the big model in various financial scenes, and accumulated a wealth of experience. Recently, du Lesser Fullness of Grain announced the official open source "Xuanyuan 70B" financial model, which achieved excellent results in the benchmark evaluation of the two authoritative language models C-Eval and CMMLU, demonstrating the strong technical strength of du Lesser Fullness of Grain in the field of large models.

The benchmark performance of Lesser Fullness of Grain's "Xuanyuan 70B" big language model is excellent.

On September 22, du Lesser Fullness of Grain announced that the "Xuanyuan 70B" financial model is open source, and all users are free to download and try it, and announced the results of "Xuanyuan 70B" in the two authoritative language model evaluation benchmarks of C-Eval and CMMLU. Data show that in the C-Eval list, the total score of XuanYuan-70B reached 71.9 points; in the CMMLU list, it topped the list with a high score of 71.05, ranking first among all open source models on the two authoritative lists, and it is also the first major financial model in China that ranks first in the two authoritative lists at the same time.

The C-Eval list is a comprehensive examination evaluation set jointly constructed by Tsinghua University, Shanghai Jiaotong University and the University of Edinburgh. It includes almost all the mainstream models at home and abroad, covering 52 disciplines in four major directions: humanities, social sciences, science and technology, and other majors. There are 13948 multiple choice questions and four difficulty levels: middle school, undergraduate, graduate student and occupation. It is one of the most authoritative lists of large models to judge the potential of the model.

CMMLU dataset is a comprehensive Chinese evaluation benchmark, jointly launched by MBZUAI, Shanghai Jiaotong University and Microsoft Research Asia. It is specially used to evaluate the knowledge and reasoning ability of language models in Chinese context, covering a total of 67 topics, involving natural sciences, social sciences, engineering, humanities and common sense.

Du Lesser Fullness of Grain promotes the business innovation of the financial industry with the help of the big model

The financial industry has rich scenes and a high degree of digitization, which is one of the best scenarios for the landing application of large models. However, finance is also an industry with high compliance requirements, and the business decision-making is complex, so there are still many challenges for the real application of large models in financial business.

Xu Dongliang, CTO of du Xiaoman, said, "compared with the general model, the 'Xuanyuan 70B' financial model has a more professional, accurate, controllable and secure understanding of financial knowledge through the massive financial data training deposited in Lesser Fullness of Grain's business scenario. We open source the large model, hoping to reduce the threshold for the deployment and application of the big model in the financial industry, and promote a breakthrough in service efficiency and service experience in the financial industry."

Xuanyuan 70B will open source financial models and 50G high-quality financial corpus in the community at the same time.

In May this year, Lesser Fullness of Grain opened up China's first financial model with hundreds of billions of parameters, and hundreds of financial institutions have applied for trial. Compared with the previous version, the ability of the new version of the large model is comprehensively improved: in the incremental pre-training and instruction fine-tuning phase, a large amount of financial data from Lesser Fullness of Grain's business scenarios are added to respond to financial problems more professionally. the ability to understand financial knowledge has been significantly improved; at the same time, in the pre-training phase, the context length of the model "Regulatory 70B" has been expanded to 8k, which can handle longer financial reports, research and analysis.

Du Lesser Fullness of Grain has been laying out large models for many years, promoting innovation and reform in the financial industry with the help of cutting-edge science and technology. In the future, the large model will still be the mainstream technology of the financial industry. Accelerating the application and landing of the large model in the financial scene will further promote the innovation and development of the financial industry. In addition to the open source "Xuanyuan 70B", Lesser Fullness of Grain will continue to strengthen cutting-edge scientific and technological innovation to promote the high-quality development of the financial industry with innovative science and technology.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.