SK Hynix Unveils First Prototype of Generative AI Accelerator Card 'AiMX'

Completed by connecting GDDR6-AiM chip
Specialized product for large language models (LLM)

SK Hynix announced on the 18th that it participated in the 'AI Hardware & Edge AI Summit 2023,' held for three days starting on the 12th (local time) at the Marriott Santa Clara Hotel in California, USA, where it unveiled and demonstrated the prototype of 'AiMX,' a generative AI accelerator card based on Graphics Double Data Rate (GDDR)6-AiM for the first time.

The AI Summit is an annual event hosted by the UK marketing company Kysaco Research. It aims to share AI and machine learning development achievements with participation from global IT companies and renowned startups. This year marks SK Hynix's third time participating in the summit.

The company introduced the slogan "SK Hynix's PIM Semiconductor AiM Accelerating AI Performance" at this summit and showcased the GDDR6-AiM and the AiMX accelerator card prototype, which improves performance by connecting multiple such products for the first time.

Prototype of the accelerator card 'AiMX' that improves performance by connecting multiple GDDR6-AiM /
[Photo by SK Hynix Newsroom]

AiM is the product name of SK Hynix's PIM (Processing In Memory) semiconductor, a next-generation technology that adds computing functions to memory semiconductors to solve data movement latency issues in AI and big data processing fields, and GDDR6-AiM belongs to this product family. AiMX is an SK Hynix accelerator card product specialized for large language models (LLM) such as ChatGPT, using GDDR6-AiM chips. An accelerator is a general term for special-purpose hardware devices made using chips designed for various information processing and computation.

SK Hynix demonstrated Meta's generative AI 'OPT (Open Pre-trained Transformer) 13B' model on a server system equipped with the AiMX prototype. The AiMX system equipped with GDDR6-AiM chips showed a response speed more than 10 times faster and power consumption at one-fifth the level compared to systems equipped with graphics processing units (GPU).

The company also held a session presentation explaining the specific advantages of AiMX. Im Yeo-cheol, Vice President of SK Hynix (in charge of Memory Solutions), explained the future of next-generation intelligent memory semiconductors by comparing GPU and AiMX performance under the theme "Efficient AiM Acceleration Solution for Generative AI Services."

Vice President Im said, "SK Hynix AiMX is a solution that offers higher performance, lower power consumption, and cost savings compared to using GPUs," adding, "We will continue to develop memory technologies that will lead the AI era."

This content was produced with the assistance of AI translation services.