Shulou(Shulou.com)11/24 Report--

The latest platform updates, the access of Adobe Firefly, the import of OpenUSD to RealityKit and the Ada architecture system will jointly accelerate the process of interoperable 3D workflows and industrial digitization.

Los ANGELES-SIGGRAPH-Pacific time August 8, 2023-NVIDIA today released a major update to the NVIDIA Omniverse ™platform, providing developers and industrial enterprises with new basic applications and services that enable them to use the OpenUSD framework and generative AI to optimize and enhance their 3D workflows.

Omniverse is an OpenUSD native software platform that connects, describes, and simulates across 3D tools and applications. This update will accelerate the creation of virtual worlds and advanced workflows and promote the process of industrial digitization. Cesium, Convai, Move AI, SideFX Houdini, and Wonder Dynamics are now connected to Omniverse through OpenUSD.

This platform update mainly upgrades Omniverse Kit (the engine for developing native OpenUSD applications and extensions), as well as NVIDIA Omniverse Audio2Face ™basic applications and spatial computing capabilities.

Rev Lebaredian, vice president of NVIDIA Omniverse and analog technology, said: "Industrial companies are competing to digitize workflows, which increases the demand for OpenUSD-enabled, interconnected and interoperable 3D software ecology. The latest Omniverse updates allow developers to enhance their tools through OpenUSD and use generative AI to enhance their tools and enable companies to build larger and more complex world-class simulations as a digital test farm for their industrial applications."

Important improvement

Updates to Omniverse Kit include:

● new modular application building: the new Omniverse Kit Extension Registry is a central repository for accessing, sharing, and managing Omniverse extensions, and developers can easily turn on or off features in their applications, making it easier than ever to build custom applications with more than 600 core Omniverse extensions provided by NVIDIA.

● new developer templates and resources: new application and experience templates make it easy for developers who are just starting to use OpenUSD and Omniverse with very little coding.

● improves efficiency and user experience: the new rendering optimization feature takes full advantage of the improvements in the NVIDIA Ada Lovelace architecture in NVIDIA RTX ™GPU and fully integrates DLSS 3 technology into the Omniverse RTX renderer. The new AI noise canceller can realize real-time 4K path tracking of large industrial scenes.

● spatial integration driven by native RTX: the new extended reality (XR) developer tool allows users to build native spatial computing options in Omniverse-based applications, giving users the flexibility to experience 3D projects and virtual worlds in their own way.

These platform updates are shown in Omniverse basic applications. Omniverse basic applications are fully customizable reference applications that creators, enterprises and developers can copy, extend or improve. Upgraded applications include:

● Omniverse USD Composer: enables 3D users to assemble large OpenUSD-based scenes

● Omniverse Audio2Face: provides access to a generative AI API that can create realistic facial animations and gestures from audio files. Multilingual support and a new basic model for women have also been added.

OpenUSD extends Omniverse Ecology

NVIDIA has also released a series of frameworks, resources, and services for developers and enterprises to accelerate the adoption of common scenario descriptions, or OpenUSD.

In addition, NVIDIA announced the construction of a new Omniverse Cloud API for developers to implement and deploy OpenUSD workflows and applications more seamlessly. For example, ChatUSD is a large language model (LLM) copilot tool for developers that can answer USD knowledge questions or generate Python-USD code scripts.

The new Omniverse connector supported by OpenUSD has been launched, which brings more possibilities for industrial enterprises to break the data isolated island in the complex production line.

Adobe and NVIDIA announced plans to provide Adobe Firefly (Adobe's creative generation AI model series) as the API of Omniverse to developers and creators to help them improve the design process. The move expands the cooperation between the two sides in Adobe Substance 3D, generative AI and OpenUSD projects.

Wonder Dynamics has been connected to Omniverse and provides new OpenUSD export support through its AI platform Wonder Studio. The Wonder Studio AI platform can automatically animate computer-generated characters, add lighting, and synthesize them into real-time action scenes. The new OpenUSD export support will allow artists to generate and export a complete 3D scene using only videos captured with a single camera.

Reality capture models made by Luma AI in USDZ format can be imported into Omniverse at any time. Tools from virtual image company Convai and role engine company Inworld AI are also plugged into Omniverse. With the help of AI tools such as Convai, creators can add roles in the digital twin environment, which can provide information about the environment and objects, and can also act as tour guides or virtual robots. Move AI implements single-camera motion capture through the Move One application, and the captured images can be used to generate 3D character animation, which is then exported to OpenUSD and used in Omniverse.

Omniverse users can now build content, experiences, and applications that are compatible with other OpenUSD-based spatial computing platforms such as ARKit and RealityKit. In addition, the new support for Khronos Group OpenXR open standards extends the application of Omniverse to more headsets produced by manufacturers such as HTC VIVE, Magic Leap and Varjo.

SideFX Houdini users can now also load Houdini Digital Assets directly into the Omniverse window, making Houdini-based interconnected workflows more seamless. Cesium's Omniverse extension Cesium for Omniverse supports 3D Tiles. 3D Tiles is an open standard for transferring large-scale geospatial data sets in virtual worlds, including those supported by OpenUSD. CGI.Backgrounds can now use a variety of UHD HDRi maps in USD Composer. Cadence DataCenter Design Software ™is now available on Omniverse to help users view computational fluid dynamics simulations in complete digital twin scenarios. With the Cadence data Center extension, users can plan, test, and validate design and operational considerations prior to implementation. Blackshark.AI World Digital Twin platform is now connected to Omniverse.

Customers use Omniverse to achieve digitization

A number of customers are using Omniverse to accomplish everything from simulating robots to training AI models and improving animation.

The Boston Institute of dynamic artificial Intelligence (Boston Dynamics AI Institute) is using Omniverse to simulate robots and their interactions to promote the design of new robots and control systems. Continental Group, a leader in automotive and autonomous system industrialization, is using Omniverse in its mobile robot business to generate physics-compliant synthetic data on a large scale to train computer vision AI models and perform system integration tests.

Volvo has converted its digital twins to OpenUSD format, using Omniverse to create immersive visualization to help customers make purchase decisions online.

Brand design and experience agency Marks Design is using Omniverse and OpenUSD to simplify and improve collaboration while improving its animation, visualization, and rendering workflows.

New Omniverse system and partner

NVIDIA is working with system manufacturers around the world to provide millions of designers, architects and engineers with RTX workstations optimized for Omniverse. These new systems can carry up to four NVIDIA RTX 6000 Ada Generation GPU with NVIDIA Omniverse Enterprise software to accelerate the construction of the OpenUSD world, collaborative design of generative AI enablement, and other industrial digital applications.

Omniverse users can also take advantage of the performance of the new NVIDIA L40S GPU. This powerful general-purpose data center GPU accelerates graphics-intensive workloads.

Supply situation

The latest Omniverse version is now available for free download in public beta and will be available through Omniverse Enterprise in the near future.

Learn more about NVIDIA Omniverse and watch the SIGGRAPH keynote speech by Huang Renxun, founder and CEO of NVIDIA.

About NVIDIA

Since its inception in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. GPU, invented by NVIDIA in 1999, has driven the growth of the PC game market, redefined modern computer graphics, ushered in the modern AI era, and is promoting cross-market industrial digitization. NVIDIA is now a full-stack computing company, and its data center-scale solutions are reshaping the industry. Click to see more information.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.