Shulou(Shulou.com)11/24 Report--

Thanks to CTOnews.com net friend West Window old things, South China Wu Yanzu, Wu Fei brother's left hand, aviation Mr. clue delivery! CTOnews.com Nvidia on Tuesday unveiled an upgraded version of its next-generation Grace Hopper superchip platform, which uses HBM3e memory technology and is designed for artificial intelligence and high-performance computing. The new GH200 Grace Hopper superchip platform consists of a 72-core Grace CPU and GH100 Hopper computing GPU, but unlike the original generation, it uses HBM3e memory, memory capacity and bandwidth have been significantly improved.

According to CTOnews.com, Nvidia launched Grace Hopper super chip in March 2022, which merged CPU and GPU on a motherboard for the first time.

HBM3e memory is a new high-bandwidth memory technology that provides higher data transfer rates in a smaller space. The new GH200 Grace Hopper superchip platform is based on a 72-core Grace CPU with 480 GB ECC LPDDR5X memory and GH100 computing GPU, paired with 141 GB HBM3e memory, divided into six 24 GB stacks, and uses a 6,144-bit memory interface. Although Nvidia actually installed 144 GB of memory, only 141 GB was available.

NVIDIA's current GH200 Grace Hopper superchip platform comes with 96 GB HBM3 memory and a bandwidth of less than 4 TB / s. In contrast, the upgraded version has increased memory capacity by about 50 percent and bandwidth by more than 25 percent to 5 TB / s. Such dramatic improvements enable the new platform to run larger AI models than the original version and provide significant performance improvements (which are especially important for training).

According to Nvidia, the GH200 Grace Hopper superchip platform currently equipped with HBM3 memory is already in production and will begin commercial sales next month. The GH200 Grace Hopper superchip platform with HBM3e memory is now in sample testing and is expected to be available in Q2 2024.

Nvidia stressed that the new GH200 Grace Hopper uses the same Grace CPU and GH100 GPU chips as the original, so the company does not need to launch any new versions or steps. Nvidia said the original GH200 and the upgraded GH200 will coexist on the market, meaning the latter will be sold at a higher price point, after all, due to the higher performance brought by its more advanced memory technology.

Nvidia says the next-generation Grace Hopper superchip platform, equipped with HBM3e memory, is fully compatible with Nvidia's MGX server specification and can be directly compatible with existing server designs.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.