Meta's custom AMD MI400-series chip is designed to be half the size of a standard MI455X, specifically optimized for recommendation system (recsys) workloads and cost-per-memory bandwidth. This tailored design will utilize approximately 144GB of HBM, a significant reduction from the 432GB typically found in the standard MI455X chip.
Hyperscalers are driving custom AI accelerator designs with reduced HBM, shifting demand away from high-bandwidth memory for specific inference workloads.