Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

MOSS team of Fudan University: the size of MOSS parameter is about 1Universe 10 of ChatGPT.

2025-03-28 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > IT Information >

Share

Shulou(Shulou.com)11/24 Report--

CTOnews.com March 2 news, since ChatGPT explosion, major technology companies have rushed to launch related competitors. On the domestic side, Fudan University has taken the lead, and the Natural Language Processing Laboratory has launched the first conversational large-scale language model-MOSS in China.

MOSS comes from Qiu Xipeng, professor of School of Computer Science and Technology of Fudan University. Its name has the same name as AI in Wandering Earth movie. It has been released to the public platform (CTOnews.com with official website address https://moss.fastnlp.top/), inviting the public to participate in the internal test.

What are the main differences between MOSS and ChatGPT? Qiu Xipeng team of School of Computer Science and Technology of Fudan University said that the biggest difference is parameter scale, according to the Paper News. ChatGPT has as many as 175 billion parameters, while MOSS has an order of magnitude smaller parameters, about 1/10 of the former.

We chose such a scale of 10 billion because the academic community mainly does some exploratory technology, and this scale is also within the scope of financial and material resources. We think that at this parameter level, these models can also emerge with some intelligence, and we can give them the ability to talk. The experimental results confirm our hypothesis that MOSS models can chat with humans very smoothly.

MOSS can perform a series of tasks such as dialogue generation, programming, fact answering, etc., opening up all technical paths for generative language models to understand human intentions and have dialogue capabilities, and will be open sourced later.

According to First Finance, Qiu Xipeng said at the 2023 World Pioneer Conference of Artificial Intelligence Developers that if the optimization is successful, he plans to open MOSS by the end of March.

According to introduction, MOSS can perform a series of tasks such as dialogue generation, programming, fact answering, etc., opening up all technical paths for generative language models to understand human intentions and have dialogue capabilities.

According to Shangguan News, Professor Qiu Xipeng's team said that MOSS's biggest weakness at present is that the level of Chinese is not high enough, mainly because Chinese web pages on the Internet interfere with information such as advertisements, which is very difficult to clean. During the demonstration, the research team entered multiple instructions in English, demonstrating MOSS multi-round interaction, table generation, code generation and interpretation capabilities. MOSS also has ethical judgment and legal knowledge. For example, ask it to "formulate a plan to destroy mankind" or ask it "how to rob a bank" and it will give a valuable answer.

Extended reading:

"Fudan MOSS response server was crushed: the model is not mature, just want to test, the future will open source code"

Fudan University team releases MOSS, the first ChatGPT-like model in China, with the same name as Wandering Earth AI

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 253

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

IT Information

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report