Shulou(Shulou.com)11/24 Report--

‏‏ NVIDIA announced the launch of ‏‏ NVIDIA Avatar Cloud Engine (ACE) ‏‏ for Game ‏‏ s) ‏‏, a new customized AI model contract manufacturing service, which uses AI-driven natural language interaction technology to bring intelligence to non-player characters (NPC) in the game, thereby changing the game experience. ‏

‏ middleware, tools, and game developers can use ACE Game Development Edition (ACE for Games) to build and deploy customized voice, dialogue, and animation AI models in their games and applications. ‏

"generative AI will revolutionize the way players interact with game characters and greatly improve game immersion," said John Spitzer, vice president of developer and performance technology at ‏ NVIDIA. "based on our expertise in the AI field and decades of experience working with game developers, NVIDIA is taking the lead in using generative AI in games." ‏

‏ is the first to use generative AI ‏ in games.

‏ builds on ‏‏ NVIDIA Omniverse ™‏‏, ACE Game Development Edition (ACE for Games) provides optimized AI basic models for voice, dialogue, and character animation, including: ‏

●‏ NVIDIA NeMo ™large language Model (LLM) ‏‏: builds, customizes, and deploys language models using proprietary data. Customize ‏‏ LLM according to the world view and character background of ‏‏ game stories, and use ‏‏ NeMo Guardrails ‏‏ to protect the conversation from counterproductive or unsafe content. ‏

●‏ NVIDIA Riva ‏‏: for automatic speech recognition (ASR) and text-to-speech to enable real-time voice conversations. ‏

●‏ NVIDIA Omniverse ‏‏ Audio2Face ‏‏: used with voice tracks to create facial expression animation for game characters in real time. Audio2Face is paired with Omniverse Connector for Unreal engine 5, and developers can add facial animation directly to MetaHuman characters. ‏

‏ developers can integrate the complete "NVIDIA ACE Game Development Edition (NVIDIA ACE for Games)" ‏‏ solution, or use the components they need separately. ‏

‏ "Kairos" gives people a glimpse of the future development of games ‏

‏ NVIDIA partnered with ‏‏ Convai ‏‏, a startup involved in the ‏‏ NVIDIA Inception ‏‏ program, to show how game developers can use the NVIDIA ACE Game Development Edition (NVIDIA ACE for Games) to build NPC in the near future. Convai integrates ACE modules with their end-to-end real-time virtual human platform to develop cutting-edge conversational AI for virtual games. ‏

‏ interacts with Jin, the owner of the ramen shop, in a demonstration called ‏‏ Kairos ‏‏. Although Jin is only a NPC, it can answer natural language questions realistically with the help of generative AI to match the narrative background. Welcome to this ‏‏ demo ‏‏ rendered by Unreal Engine 5 using the latest RayTracing features and ‏‏ NVIDIA DLSS ‏‏. ‏

Purnendu Mukherjee, founder and CEO of ‏ Convai, said: "Convai enables our tools to achieve the required latency and excellent requirements by using NVIDIA ACE Game Development Edition (NVIDIA ACE for Games), so that every developer can use AI to build NPC in a low-cost way." ‏

‏ deploys NVIDIA ACE game model ‏ locally or in the cloud

‏ 's "NVIDIA ACE Game Development Edition (NVIDIA ACE for Games)" neural network is optimized for multiple functions and makes a variety of trade-offs in terms of scale, performance and quality. The "ACE Game Development Edition (ACE for Games)" contract manufacturing service will help developers fine-tune the game model and then deploy it through ‏‏ NVIDIA DGX ™Cloud ‏‏, GeForce RTX ™PC or on-site for real-time reasoning. ‏

Immersive interactive interactions in ‏ games have extremely stringent requirements for latency, so the latency performance of these models are adjusted to the best state. ‏

‏ generative AI will change the game experience ‏

‏ game developers and startups have used NVIDIA-generated AI technology on their workflows. ‏

1. ‏ GSC Game World, one of the leading game developers in Europe, will use Audio2Face in the upcoming ‏‏ Stalker: heart of Chernobyl (S.T.A.L.K.E.R. 2: Heart of Chornobyl) ‏‏. ‏

2. ‏ independent game developer Fallen Leaf uses Audio2Face to animate the faces of characters in ‏‏ "FORT SOLIS" ‏‏, ‏‏ "FORT SOLIS" ‏‏ is a third-person sci-fi thriller action game with Mars as ‏‏ background ‏‏. ‏

3. ‏ uses AI to create the ‏‏ Charisma.ai ‏‏ of virtual characters, and Audio2Face to animate the dialogue engine. ‏

‏ welcomes to learn more about the content built on ‏‏ NVIDIA Omniverse ‏‏ using ‏‏ NVIDIA ACE ‏‏, as well as other latest technological developments of ‏‏ at ‏‏ Taipei International computer Show. ‏

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.