Shulou(Shulou.com)11/24 Report--

Thanks to CTOnews.com netizens Wu Yanzu in South China for the delivery of clues! CTOnews.com March 22 news, Nvidia in the GTC Spring 2023 keynote speech, aimed at the growing AI market, launched a new dual GPU product H100 NVL. The H100 NVL is equipped with three NVLink connectors at the top, using two adjacent PCIe video card slots.

Nvidia says that when running a large language model (LLM), the video memory of a conventional graphics card cannot handle large data streams. Therefore, the H100 NVL launched this time can provide up to 188GB HBM3 video memory, single card video memory capacity 94GB.

The H100 NVL consumes slightly more power than the H100 PCIe, with an increase of 50W from 350W to 400W per GPU (configurable). CTOnews.com learned from the report that the overall performance is actually twice that of the H100 SXM: 134teraflops,TF32, 1979 teraflops,FP8, 7916 teraflops,INT8, 7916 teraops.

The memory bandwidth is also much higher than that of H100 PCIe, with a total of 7.8 TB / s per GPU (2 TB / s for H100 PCIe and 3.35 TB / s for H100 SXM).

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.