Business Pill · Only so many per minute
A rate limit is a cap on how many requests a customer may send each minute. For an AI product it means the busiest minute is capped by someone else’s capacity.
A short explainer video, under a minute. The restaurant and the doorman are an illustration.
At a glance
What a Rate Limit Is
On launch day, a company's new app sends more requests than its allowance, and the answers stop.
What It Means for a Product
The video's board puts it in one line: it means your busiest minute is capped by someone else's capacity.
Why It Matters
The video turns this into one question: what happens to our product in its busiest minute?
The Short Answer
Picture a restaurant with one kitchen. At eight o’clock everybody orders at once, so the door lets in only so many tables per minute. The rest wait outside.
AI providers do the same. Their chips are the kitchen.
What a Rate Limit Is
On launch day, a company’s new app sends more requests than its allowance, and the answers stop.
That allowance is called a rate limit: a cap on how many requests a customer may send each minute.
What It Means for a Product
The video’s board puts it in one line: it means your busiest minute is capped by someone else’s capacity.
The busiest minute is the one that matters most, and it is the one the cap bites hardest.
The Idea in Parts
The lesson in its own parts
What a Rate Limit Is
On launch day, a company's new app sends more requests than its allowance, and the answers stop.
What It Means for a Product
The video's board puts it in one line: it means your busiest minute is capped by someone else's capacity.
The Ways Out
The video lists three ways out: reserve capacity in advance, queue the work that can wait, or keep a second provider ready.
The Ways Out
The video lists three ways out: reserve capacity in advance, queue the work that can wait, or keep a second provider ready.
Why It Matters
The video turns this into one question: what happens to our product in its busiest minute?
Computing power is shared and finite. Know your limit before your launch.
The key insight: Computing power is shared and finite. Know your limit before your launch.
Where This Shows Up in AI Business Today
From our news coverage
OpenAI Says It Disrupted a Distillation Campaign
Request volume is one of the signals in OpenAI’s account of a distillation campaign. In our report, OpenAI says high-volume spikes on 24 and 25 July consisted of 16,000 requests using a relevant extraction pattern from over 4,000 users, and that related prompt-pattern activity across a cluster of more than 15,000 users was fully disrupted by 28 July.
From our news coverage
The post is OpenAI’s own account, dated 30 September 2026, and our report verified none of it independently.
The Business Engineer Lens
Where this idea sits in the Business Engineer library:
The Question to Ask
- What happens to our product in its busiest minute?
How This Concept Connects
Layer 3 of 8 · Inference & Context, on the Business Engineer Concept Map
- Rate Limits builds on GPUs. Providers cap requests because their chips are the kitchen: computing power is shared and finite.
- Rate Limits contrasts with Why AI Canโt Be Both Instant and Cheap. Both are about busy capacity: rate limits cap requests per minute, batching trades each user’s wait for more answers overall.
- Rate Limits builds on Declared Identity (lesson unlocks soon). A cap on how many requests a customer may send needs to know which customer is asking, which declared identity provides.
The State of the Inference Economy
Shared, finite serving capacity.
Get the full Concept Map as a free poster.
Related Business Pills
All Business Pills
- The Memory Wall: Why a Faster AI Chip Is Not Faster AI
- Tokens per Watt: What an AI Data Centre Actually Produces
- Why AI Can’t Be Both Instant and Cheap: Latency vs Throughput
- The Model and the Harness: Why Same-Model Products Differ
- Context, Not Capability: Why a Smart AI Model Gives Poor Answers
- Discardable Software: When Code Is Cheap Enough to Throw Away
- Human in the Loop vs Human on the Loop: Supervising AI Agents
- The AI Audit Problem: When Making Work Is Cheaper Than Checking It
- AI Evaluation as Acceptance Test: How to Know It’s Good Enough
- Extensibility Is Control: Who Holds the Power in an AI Product
- RLHF Explained: How an AI Model Learns What People Prefer
- Pretraining Explained: How an AI Model Learns Before Anyone Teaches It
- Fine-Tuning Explained: How to Adapt a General AI Model to One Job
- Tokens Explained: The Unit AI Reads, Writes and Bills In
- Embeddings Explained: How a Machine Compares Meaning
- RAG Explained: How a Model Answers From Your Documents
- AI Hallucination Explained: Why Models State False Things
- Distillation Explained: How a Small Model Learns From a Large One
- Reasoning Models Explained: What Changes When AI Thinks First
- Tool Use Explained: How an AI Model Goes From Text to Action
- Capex and Depreciation Explained: Why Chip Lifetime Drives AI Profits
- Run-Rate Revenue Explained: What an AI Company’s Number Means
- Backlog Explained: Revenue That Is Signed but Not Yet Earned
- Switching Costs Explained: Why It Is Hard to Leave an AI Supplier
- Temperature Explained: The Dial That Sets How Predictable an AI Model Is
- Guardrails Explained: Rules Enforced Around an AI Model, Not Inside It
- Benchmarks Explained: Why a Test Score Is Not Your Own Result
- Agent Memory Explained: How an AI Assistant Remembers You Between Chats
- MCP Explained: The Shared Plug That Connects AI Models to Tools
- Quantization Explained: How a Large AI Model Is Shrunk to Fit
- Parameters Explained: Where an AI Model’s Knowledge Lives
- Scaling Laws Explained: Why AI Labs Keep Building Bigger
- Synthetic Data Explained: When a Model Writes Its Own Training Examples
- Transformers and Attention Explained: How AI Reads Every Word at Once








![What Can Be Benchmarked Can Be Made Autonomous [Video Explainer] What Can Be Benchmarked Can Be Made Autonomous [Video Explainer]](https://i0.wp.com/fourweekmba.com/wp-content/plugins/contextual-related-posts/default.png?resize=150%2C150&ssl=1)
