Shulou(Shulou.com)11/24 Report--

Sina Science and Technology News on the evening of November 7, Sina Science and Technology learned that a number of teams of Alibaba are jointly developing a terminal interaction engine fully taken over by digital people. The first "Digital Man + Terminal" product is expected to provide a user experience in the first quarter of 2023. According to reports, the project integrates Dharma NLP, voice, vision, 3D construction driver and large model domain team, and Tmall elf AliGenie interactive system experts.

Just as the finger touch screen lays the foundation for smartphone interaction, the big model digital man will take over the future intelligent interaction. Starting from 2022, the Dharma House multimodal large model began to be applied to Tmall elf voice search and encyclopedic scenes. At present, the parties are pushing the cooperation scene to the system layer and user awareness layer of AliGenie interaction.

At present, the field of digital human is changing from noisy to rational. Although high-precision and good-looking dolls continue to appear, most of the scenes lack continuous and personalized interaction with users, so the scale of commercialization is limited. For example, virtual idols that can only exist in short videos and animations, or virtual employees who only support Q & An in a single device or interface, these forms lack large-scale model training and large-scale interaction, and cannot be personalized learning and upgrading. Users feel like "soulless".

At the just-concluded Yunqi conference, Li Xiaolong, a researcher from Alibaba Group, revealed that the Dharma Institute has accumulated multimodal large models, voice, natural language, 3D construction drivers, and 100 patents and top papers in various fields in the past two years. Through the verification of these results, in many interactive scenarios, a digital human engine based on multimodal large models has begun to take shape.

Lu Yong, head of product planning of Tmall Spirit, said that the terminals connected to the AliGenie system have covered more than 40 million households and 460 million of more than 1600 brands have been connected to the products, allowing digital people to interact with users in a sustainable, large-scale and combined scene. AliGenie previously announced that only smart speaker products interact more than 8 billion times a month, and 70% are active services. Many consumer hardware manufacturers are also eager to have an intelligent experience that goes beyond a single connection, a single device conversation.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.