Shulou(Shulou.com)11/24 Report--

CTOnews.com, December 15, Samsung has created the world's first large computing system using graphics cards with built-in PIM (processing-in-memory). Citing Business Korea, the training performance of AI has been improved by 2.5 times by using 96 PIM-modified AMD Instinct MI100 GPU.

PIM is a new type of computer memory, which can accelerate the processing power of processors such as CPU and GPU. The most important feature of PIM is that each memory module can process data on its own, thus reducing the amount of data needed to transfer between memory and processors.

Samsung publicly showed off the PIM-modified GPU in October, but now the company has put 96 PIM-modified GPU in the cluster. Compared with ordinary video memory, these improved MI100 chips not only improve the performance by 2.5 times, but also reduce the power consumption by 2.67 times, which greatly improves the efficiency of GPU when running AI algorithm.

Samsung has been developing PIM for some time. The company demonstrated a variety of implementations in 2021, involving many different memory types, including DDR4, LPDDR5X, GDDR6, and HBM2. In the form of LPDDR5, Samsung saw a 1.8-fold increase in performance, a 42.6% reduction in power consumption and a 70% reduction in latency in test programs involving Meta AI workloads.

CTOnews.com learned that the AMD Instinct MI100 accelerator has been redesigned to meet the new era of computing in an all-round way. 1 MI100 accelerator adopts AMD CDNA architecture, which has made a great leap forward in computing and interconnection performance. Compared with the previous generation AMD accelerator, the performance of high performance computing (FP32 matrix) is nearly 3.5 times higher, while the performance of artificial intelligence (FP16) is nearly 7 times higher.

Samsung is not the only company to develop PIM chips-SK Hynix released its own PIM module earlier this year. According to preliminary tests by SK Hynix, its GDDR6-AiM (memory Accelerator) application can increase AI processing speed by 16 times and reduce power consumption by 80%. This is much faster than Samsung's revised MI100s, but we don't know what tools SK hynix uses for testing, so we can't compare it directly.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.