Samsung has developed the world’s first large-scale computing system that connects nearly 100 AMD Instinct MI100 GPUs with PIM technology.
Samsung unveils large-scale computing system with nearly 100 AMD Instinct MI100 GPUs with PIM technology
PIM chips combine the processor with RAM on a single chip. This technological advancement is expected to aid in the large-scale performance of AI workloads. In October, Samsung revealed that the company demonstrated how the performance of a PIM chip can be combined with an AMD GPU. When the company trained the T5 language model algorithm with this next-generation hack, performance more than doubled while lowering power consumption in a system without PIMs.
Now we have the world’s first large-scale computing system with 96 AMD Instinct MI100 GPUs integrated with “in-memory” PIM technology, allowing AI algorithms to be boosted.
We built a large computing system by combining 96 AMD MI100 GPUs in the US, each one loaded with a PIM chip. It is the only one of its kind in the world.
– Choi Chang-kyu, Vice President and Head of the Artificial Intelligence Research Center, Samsung Electronics Advanced Institute of Technology
The artificial intelligence of science and technology has found acceptance in today’s world, as well as showing broad support in semiconductor production processes. According to Choi, the company is also exploring ways to combine the knowledge the company’s engineers have with inspection data and find use for it in production.
As the head of the AI Research Center, I want to make Samsung a semiconductor company that uses AI better than any other company.
The current method for checking throughput is limited, as testing can only be done every three to six months when chips are put in and taken out of the factory. We need to move to a stage where returns can be predicted using AI sensors and screening data.
The Conference on Artificial Intelligence for Future Semiconductor Technology brought organizations to the conference site in Korea, such as the Semiconductor AI Forum, the Next Generation Semiconductor Foundation, and the PIM Artificial Intelligence Semiconductor Project Group, as well as industry demos, such as DEEPX, Eyenix, ETRI, and Furiosa. AI, Nextchip, Nepes, Openedges Technology, SAPEON Korea, and Telechips.
News source: Business Korea