State of AI Compute Index Refreshed, Shows Shifting GPU Landscape

The State of AI Compute Index has been updated, providing a comprehensive overview of the AI hardware landscape through July 2026. The report highlights a significant shift in NVIDIA's product cycle, with Hopper (H100/H200) GPU deployments more than doubling and becoming the dominant installed base, while the older A100 fleet is declining. Blackwell deployments are still nascent but growing rapidly. Despite challengers like AMD and Huawei making inroads, NVIDIA continues to dominate chip citations in AI papers, accounting for approximately 91% of mentions. However, the demand side shows major players like OpenAI diversifying their compute contracts, with a majority of their disclosed book now being non-NVIDIA. The Grace-Blackwell pipeline indicates massive future deployments, though only a small fraction is currently operational. The index also tracks startup silicon, noting Groq as the most-cited startup chip before its acquisition by NVIDIA. Overall, the data suggests a dynamic market with NVIDIA maintaining a strong lead, but with increasing diversification in compute procurement and significant future build-outs across various vendors.