Shulou(Shulou.com)11/24 Report--

CTOnews.com August 8 news, Microsoft in March this year and NVIDIA cooperation, announced the launch of Azure ND H100 v5 VM virtual machine preview; after months of testing, Microsoft officially launched the virtual machine today, to help enterprises more efficiently handle generative AI tasks.

CTOnews.com previously reported that ND H100 v5 VM is Azure's most powerful and highly scalable AI VM family to date.

The virtual machine supports on-demand configurations of up to eight to a thousand NVIDIA H100 GPUs interconnected by Quantum-2 InfiniBand networks, resulting in significantly improved performance for AI models. Compared to the previous generation ND A100 v4 VM, this virtual machine includes the following innovative technologies:

8 NVIDIA H100 Tensor Core GPUs interconnected via next-generation NV Switch and NV Link 4.0.

In a non-blocking fat-tree network, each GPU is powered by 400 Gb / s NVIDIA Quantum-2 CX7 InfiniBand and 3.2 Tb/ s performance per VM.

The eight local GPUs in each VM are interconnected by NV Switch and NV Link 4.0 with 3.8Tb / s pairs of split bandwidth.

Fourth generation Intel Xeon Scalable processors.

PCIE 5th generation host-to-GPU interconnect with 64Gb / s bandwidth per GPU.

16 channels of 4800 MHz DDR5 memory.

The new virtual machines use NVIDIA Tensor Core H100 GPUs and NVIDIA Quantum-2 InfiniBand networks, which are currently limited to Azure enterprise access in the Eastern and Western United States.

Microsoft added that the company is working to add hundreds of thousands of new GPUs to its virtual machines over the next year.

In addition to officially announcing the Azure virtual machine, Microsoft also announced the expansion of its Azure OpenAI service, launching in Eastern Canada, East United States 2, Eastern Japan and Southern United Kingdom.

Microsoft says Azure OpenAI has more than 11000 customers, attracting an average of 100 new customers per day this quarter.

This significant growth demonstrates the value and scalability of our services for businesses eager to harness the potential of AI to meet their unique needs.

Microsoft also added that GPT-4, the most powerful version of the ChatGPT AI platform, will also be available in the new Azure OpenAI service region.

Related Reading:

Microsoft Azure ND H100 v5 VM Preview Release: Using 8 to 1,000 NVIDIA H100 Tensor Core GPUs

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.