Shulou(Shulou.com)11/24 Report--

Thanks CTOnews.com netizen soft media new friend 1933769, OC_Formula clue delivery! CTOnews.com Qualcomm announced Cloud AI 100 Ultra, a Cloud AI inference accelerator designed for generative AI and large language models.

This product offers four times the performance of the previous generation, can deploy 100B parameters on a single 150W card, 175B parameters on two cards, and even support larger models through multiple Cloud AI 100 Ultra of Qualcomm AI Stack and Cloud AI SDK.

Qualcomm Cloud AI 100 Ultra is a programmable AI accelerator that supports the latest AI technologies and data formats.

It leverages the Qualcomm AI stack to enable customers to "train anywhere and reason on Qualcomm Cloud AI 100 Ultra" to support model migration and optimization.

As its name suggests, this is a cloud accelerator card that relies on HPE ProLiant DL380a Gen 11 servers designed by HPE Technologies for accelerator-optimized generative AI workloads (CTOnews.com Note: includes NLP).

According to Qualcomm officials, the Cloud AI 100 platform leads all accelerator cards in the latest benchmark results, but the specific results of the latest Cloud AI 100 Ultra are unclear.

Qualcomm said that in cloud and enterprise use cases, Qualcomm Cloud AI 100 Ultra delivers two to five times the performance per TCO dollar compared to competitors in generative AI, including LLMs, NLP and computer vision workloads.

They argue that this combination of performance, pricing, power, efficiency, scalability and security makes it ideal for organizations looking to adopt cutting-edge AI and transform their operations while supporting sustainability goals.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.