GPUs Explained: Why AI Runs on a Chip Built for Video Games

GPUs Explained: Why AI Runs on a Chip Built for Video Games

Business Pill · The chip behind AI

A GPU is a chip that does enormous numbers of simple sums side by side. It was built to draw video games and turned out to be right for AI, which is why AI progress is tied to a supply of chips.

A short explainer video, under a minute. The accountant, the clerks and the robot are an illustration.

At a glance

What a GPU Is

That chip is the GPU, the graphics processing unit.

Why It Fits AI

The reason is that the work of a model is exactly that: enormous numbers of simple sums that can be done side by side.

Why It Matters

The video turns this into one question: how much of our AI plan depends on chips we do not control?

The Short Answer

Picture a robot that has a billion small sums to do for every answer. A normal chip is like one brilliant accountant. It does each sum one after another, very fast, but still one at a time.

Another kind of chip is like a hall of ten thousand clerks. Each one is slower, but they all work at once.

What a GPU Is

That chip is the GPU, the graphics processing unit. It was built to draw video games, and it turned out to be right for AI.

The video’s board sets the two chips side by side. The normal chip has a few, brilliant workers and does the sums one after another. The other has thousands of simple workers and does them all at once.

Why It Fits AI

The reason is that the work of a model is exactly that: enormous numbers of simple sums that can be done side by side.

A chip that does one sum at a time, however fast, is the wrong shape for that work.

The Idea on One Board

What a GPU Is

The normal chip

The normal chip has a few, brilliant workers and does the sums one after another.

The other chip

The other has thousands of simple workers and does them all at once.

Why the Chips Are Scarce

This is why AI progress is tied to a supply of chips. The video’s board lists why it matters: the chips are scarce, costly and hungry for power.

Why It Matters

The video turns this into one question: how much of our AI plan depends on chips we do not control?

AI runs on simple sums, done all at once. The GPU is the chip built for that.

The key insight: AI runs on simple sums, done all at once. The GPU is the chip built for that.

The honest limit

This is why AI progress is tied to a supply of chips. The video's board lists why it matters: the chips are scarce, costly and hungry for power.

Where This Shows Up in AI Business Today

From our news coverage

AMI Adds 20,000 NVIDIA Rubin GPU Orders, ~29,000 in Total

Our report on AM Intelligence says that, according to AMI, it has placed two further firm and binding orders for 20,000 NVIDIA Rubin GPUs, taking its committed capacity to approximately 29,000 GPUs. Our report on South Korea’s frontier-AI plan says the Korea Times reports an expected 3.9 trillion won to provide 10,000 Vera Rubin GPUs. Both are the sources’ own figures. These are the chips this lesson describes.

The Business Engineer Lens

Where this idea sits in the Business Engineer library:

Business Engineer Framework

The Map of AI

The Business Engineer framework maps where each part of the AI stack sits and who holds the leverage. These pills are short lessons from the same library.

Explore the Map of AI →

The Question to Ask

  1. How much of our AI plan depends on chips we do not control?

Related Business Pills

Business PillThe Memory Wall: Why a Faster AI Chip Is Not Faster AIWhy a faster AI chip does not always mean faster AI: the memory wall, memory bandwidth, and a worked example with round numbers.Business PillTokens per Watt: What an AI Data Centre Actually ProducesWhat an AI data centre actually produces: tokens. Why tokens per watt is the number that matters when power is the limit, with a worked example.Business PillCapex and Depreciation Explained: Why Chip Lifetime Drives AI ProfitsWhy the lifetime of a chip matters so much to AI profits: capital expenditure, depreciation, a worked example with round numbers, and what to ask.Business PillInference Explained: The Cost Paid on Every AI AnswerWhy the cost of AI does not end when training ends: inference, the cost paid on every answer, how it compares with training, and the one question to ask.

All Business Pills

Scroll to Top

Discover more from FourWeekMBA

Subscribe now to keep reading and get access to the full archive.

Continue reading

FourWeekMBA