AMD unveils Helios rack with 2.9 exaflops for AI training and inference

  • AMD introduced Helios as an integrated rack-scale AI system.
  • Each rack contains 72 MI455X GPUs, 18 EPYC CPUs and 31 TB of HBM4 memory.
  • Shipments are expected to begin in the second half of 2026 and ramp through 2027.

AMD unveiled Helios, a rack-scale AI system that integrates computing, networking and software in a single deployable unit, at its Advancing AI 2026 conference on July 23. Each rack contains 72 Instinct MI455X GPUs, 18 6th Gen EPYC Venice server CPUs, Pensando networking hardware and AMD's ROCm software stack. The system offers up to 2.9 exaflops of peak FP4 performance and 31 TB of HBM4 memory, while AMD says it delivers up to 30% more tokens per dollar than Nvidia's Rubin NVL72 rack. Helios is aimed at frontier model training and large-scale inference, including agentic AI workloads that require substantial CPU resources for multistep reasoning and orchestration. Anthropic has committed to deploying up to 2 GW of MI450-series GPUs in Helios racks, while OpenAI and Meta have each committed to 6 GW through their respective deals. Microsoft and Oracle are also customers. Shipments are expected to start in the second half of 2026 and increase through 2027. AMD projects the server CPU market will exceed $200 billion by 2030, compared with a Bank of America forecast above $170 billion, and says it achieved a fourfold improvement in AI energy efficiency from 2024 through mid-2026. The company is targeting a 20-fold improvement by 2030 and has open-sourced its Optima solution for optimizing internal AI processes.

本网站上的信息是使用AI生成的,我们无法保证其准确性。 请仅作为参考信息使用。
AMD unveils Helios rack with 2.9 exaflops for AI training and inference - CoinPost Terminal