Everyone expected custom chips to erode Nvidia’s position. Instead, Nvidia’s share of the AI inference chip market grew from 66% to 74% in one year — while inference became the dominant AI workload. The moat is widening, not shrinking.
The Shift That Explains Everything
AI is moving from training to inference. Training creates intelligence. Inference monetizes it.
AI startup revenue (Anthropic, OpenAI, etc.) grew from roughly $7B to $80B annualized in 18 months. Every dollar of that revenue runs through inference. And 74 cents of every inference dollar runs through Nvidia.
The Moat Is No Longer Just Hardware
The critical insight most people miss: Nvidia is behaving like an infrastructure platform, not a chip vendor.
Hardware
The GPUs everyone knows. But this is just the floor.
Software (CUDA)
The ecosystem lock-in. Every AI framework, every model, every tool is optimized for CUDA. Switching costs are enormous.
Capital
Nvidia finances the ecosystem consuming its products — billions in guarantees for data centers, strategic investments in OpenAI, Anthropic, CoreWeave.
Acquisitions
Groq acquisition (~$20B) — absorbing the most credible alternative inference chip before it could scale.
Hardware + Software + Capital + Ecosystem = Durable Moat. The competition isn’t GPU vs GPU anymore. It’s AI infrastructure ecosystem vs AI infrastructure ecosystem. And Nvidia’s ecosystem is the one with $41B in quarterly inference revenue flowing through it.
The Supercycle Read
Map this onto the nine-layer AI Supercycle:
Nvidia doesn’t just own Layer 3 (Silicon). It’s extending into Layer 4 (Networking — NVLink, InfiniBand), Layer 5 (Compute Capacity — through financing), and even Layer 7 (Harness — through CUDA’s software gravity). The company is becoming a vertical stack within the stack.
The contrarian insight: AI infrastructure is not becoming more competitive in the near term. It is becoming more concentrated. Demand is growing faster than alternatives can scale. And Nvidia is financing the ecosystem that consumes its own products — a self-reinforcing loop that gets stronger with every dollar of inference revenue.
The Bottom Line
The market expected Nvidia’s inference share to decline as custom chips scaled. Instead it went from 66% to 74%. The company now captures $41 billion per quarter from inference alone — nearly three-quarters of every inference dollar spent on Earth. Nvidia isn’t just selling chips into the AI supercycle. It’s becoming the operating system that the supercycle runs on.
Source: The Information









