Shulou(Shulou.com)11/24 Report--

CTOnews.com, October 12, according to the official website of AAAI (International Association of Advanced AI), taking the lead of learning and thinking, together with experts and scholars from Google, Jinan University and other science and technology enterprises and universities, will jointly hold the AAAI 2024 Global large Model Mathematical reasoning Competition.

The competition is divided into two directions: Chinese math problem solving and English math problem solving. The Chinese and English data sets TAL-SAQ7K-CN and TAL-SAQ6K-EN are provided by learning and thinking. It is said that the data set includes the real problems of mathematics competitions in primary and secondary schools at home and abroad.

This competition will also be the first mathematical model problem-solving competition in the world, and the organizers have provided three benchmarks for reference: GPT-3.5, GPT-4 and MathGPT.

During the competition, contestants need to use a large model to generate reasoning steps and answers for a given mathematical problem, and the organizers will rank by comparing the accuracy between the output answer and the correct answer of the participating model. Organizers say they hope to require contestants to use a large language model to solve Kmur12 math problems in this competition. (CTOnews.com Note: Kmuri 12 refers to pre-school education to high school education, and is generally used to refer to basic education. In the American education system, it refers to the stage of control from kindergarten to 12th grade.

It is reported that the current large language model has some "congenital defects", such as lack of complex reasoning ability, inaccurate numerical calculation and so on. If large models can overcome them and successfully deal with the challenge of mathematical reasoning, AI will enter a "new era".

The schedule of the competition is as follows:

October 10, 2023: start

December 31, 2023: deadline for final submission

January 10, 2024: final results announced

The awards are as follows:

The top three winners in two directions will receive cash awards: the first prize is 1000 US dollars, the second prize is 600 US dollars, and the third prize is 300 US dollars.

The top three in both directions will receive formal certificates and will be invited to give oral presentations during the 2024 AAAI (International Association for Advanced AI) conference.

The top three first authors of the team will be invited to write a summary of the competition.

Referenc

AAAI official website announcement

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.