Business Pill 30 · When a model thinks before it answers
A reasoning model spends extra effort at the moment of the question. Better answers can now be bought with more compute at the moment of use.
A short explainer video. The numbers in it are round numbers for illustration.
The Short Answer
A standard model answers immediately. It reads the question and starts writing. That works for simple requests. But on a hard problem, the first thing that comes to mind is often wrong.
What Reasoning Is
A reasoning model does something different. Before answering, it works through the problem step by step. It tries an approach, checks it, changes course if needed, and only then does it answer.
This is called reasoning, or sometimes thinking. The model spends extra effort at the moment of the question.
A Worked Example
That thinking is not free. It is made of tokens. The model writes out its working, and you pay for every word of it, even though you may never see it.
With round numbers: a quick answer uses 500 tokens and takes two seconds. A reasoned answer may use 5,000 and take 30 seconds. That is 10 times the cost and 15 times the wait, for an answer that is right more often.

A Choice, Task by Task
For a greeting or a simple lookup, reasoning is waste. For planning, analysis or code, it is often worth every token. The skill is matching the effort to the problem.
And this changes the economics. Better answers can now be bought with more compute at the moment of use, not only with a bigger model.
Three Questions to Ask
- How hard is this task really?
- What is a better answer worth?
- How long can the user wait?
How This Concept Connects
Layer 2 of 8 · Models & Training, on the Business Engineer Concept Map
- Hidden Reasoning builds on Reasoning Models. Hidden reasoning is the private working a model does before it answers, the step-by-step thinking reasoning models add.
- Reasoning Models is priced by Tokens. Reasoning is made of tokens: you pay for every word of the working, even when you never see it.
- Reasoning Models contrasts with Model Routing. Both match effort to difficulty: reasoning spends more thinking on hard tasks, routing sends easy ones to a cheaper model.
Tokenomics: The Economics of AI
Reasoning tokens change cost per answer.
Get the full Concept Map as a free poster.
More Business Pills
- The Memory Wall: Why a Faster AI Chip Is Not Faster AI
- Tokens per Watt: What an AI Data Centre Actually Produces
- Why AI Can’t Be Both Instant and Cheap: Latency vs Throughput
- The Model and the Harness: Why Same-Model Products Differ
- Context, Not Capability: Why a Smart AI Model Gives Poor Answers
- Discardable Software: When Code Is Cheap Enough to Throw Away
- Human in the Loop vs Human on the Loop: Supervising AI Agents
- The AI Audit Problem: When Making Work Is Cheaper Than Checking It
- AI Evaluation as Acceptance Test: How to Know It’s Good Enough
- Extensibility Is Control: Who Holds the Power in an AI Product
- RLHF Explained: How an AI Model Learns What People Prefer
- Pretraining Explained: How an AI Model Learns Before Anyone Teaches It
- Fine-Tuning Explained: How to Adapt a General AI Model to One Job
- Tokens Explained: The Unit AI Reads, Writes and Bills In
- Embeddings Explained: How a Machine Compares Meaning
- RAG Explained: How a Model Answers From Your Documents
- AI Hallucination Explained: Why Models State False Things
- Distillation Explained: How a Small Model Learns From a Large One
- Tool Use Explained: How an AI Model Goes From Text to Action
- Capex and Depreciation Explained: Why Chip Lifetime Drives AI Profits
- Run-Rate Revenue Explained: What an AI Company’s Number Means
- Backlog Explained: Revenue That Is Signed but Not Yet Earned
- Switching Costs Explained: Why It Is Hard to Leave an AI Supplier
- Temperature Explained: The Dial That Sets How Predictable an AI Model Is
- Guardrails Explained: Rules Enforced Around an AI Model, Not Inside It
- Benchmarks Explained: Why a Test Score Is Not Your Own Result
- Agent Memory Explained: How an AI Assistant Remembers You Between Chats
- MCP Explained: The Shared Plug That Connects AI Models to Tools
- Quantization Explained: How a Large AI Model Is Shrunk to Fit
- Parameters Explained: Where an AI Model’s Knowledge Lives
- Scaling Laws Explained: Why AI Labs Keep Building Bigger
- Synthetic Data Explained: When a Model Writes Its Own Training Examples
- Transformers and Attention Explained: How AI Reads Every Word at Once









