Shulou(Shulou.com)11/24 Report--

CTOnews.com, October 28, according to official account of Northwestern Polytechnic University, Professor Li Xuelong of the Institute of Optoelectronics and Intelligence of Northwestern Polytechnic University and his colleagues have made innovative progress in machine interaction: equipping drones with "brains" and developing a "group chat" UAV control framework based on large models made in China.

This framework enables UAV clusters to cooperate dynamically in language communication, realizes the dialogue and interaction between "man-machine" and "multi-machine" in the open environment, breaks down the interaction barrier between human and machine, and further expands the application scene of near-ground security. (CTOnews.com Note: frontier security covers low-altitude security, underwater security and cross-domain security. It is a technical system for defense, protection, production, safety, rescue and other needs in the frontier space. It has the characteristics of diversification, cross-domain, three-dimensional, coordination, intelligence and so on. )

▲ source Northwestern Polytechnic University, the following research team put forward a "group chat" dialogue interaction method, which converts sound, image, UAV status and other information into natural language dialogue through a large model, so as to achieve independent and intuitive interaction between users and UAV and UAV.

At the same time, the research team designed a set of efficient real-time feedback mechanism, so that the UAV can report its status and seek user confirmation through dialogue at the key nodes of mission execution, which greatly improves the stability and security of complex task execution.

According to reports, the research team has also established a "group chat" control framework for autonomous drones driven by the "scholar Puyu" open source model, which realizes intelligent interaction, active perception, and autonomous control in open environments and complex tasks, so as to improve the autonomy of UAV mission execution. Through this framework, UAV cluster can achieve a series of functions, such as human-like dialogue interaction, active environment awareness, autonomous control and so on.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.