Huang described AI infrastructure as a "five-layer cake" with energy at the very bottom, preceding chips, data centers, and models. He stated that a few hundred billion dollars have been invested in this infrastructure buildout, with trillions more required.
The energy grid's capacity to scale is the primary bottleneck for AI infrastructure expansion, shifting focus from compute supply to power generation.