Business Pill · What breaks when the model under you changes
Model deprecation is a provider retiring a model version, so everything built on it has to move. The new model may be better on average and still worse at your task.
A short explainer video, under a minute. The bakery and its ordering assistant are an illustration.
At a glance
What Model Deprecation Is
That is called model deprecation. It means a provider retiring a model version, so everything built on it has to move.
What Can Go Wrong
The new model may be better on average, and still worse at your task.
Why It Matters
The video turns this into one question: what breaks when the model under us changes?
The Short Answer
Picture a bakery that builds its ordering assistant on an AI model, and tunes it for months.
One morning the provider retires that model and swaps in a newer one. The instructions are the same, but the behavior is different.
What Model Deprecation Is
That is called model deprecation. It means a provider retiring a model version, so everything built on it has to move.
What Can Go Wrong
The new model may be better on average, and still worse at your task. Prompts tuned for the old one may misfire. Cost and speed can shift.
The Idea in Parts
The lesson in its own parts
What Model Deprecation Is
That is called model deprecation. It means a provider retiring a model version, so everything built on it has to move.
What Can Go Wrong
The new model may be better on average, and still worse at your task.
The Boring Defense
The defense is boring, and it works. Pin the version.
The Boring Defense
The defense is boring, and it works. Pin the version. Keep your own test cases. Rerun them before every switch.
Why It Matters
The video turns this into one question: what breaks when the model under us changes?
The model under your product is rented. Be ready for the day it is replaced.
The honest limit
The new model may be better on average, and still worse at your task. Prompts tuned for the old one may misfire. Cost and speed can shift.
Where This Shows Up in AI Business Today
From our news coverage
ThinkingBox: Opus 5.5 and Opus 5 Tie at 241 of 507 Tasks
Two versions of one model family are being compared side by side. In our report on ThinkingBox, the post says Claude Opus 5.5 and Claude Opus 5 each pass 241 of 507 tasks on all 20 attempts, at estimated costs of $7.80 and $13.30 per dependable task.
From our news coverage
The costs are the authors’ estimates at list rates, and our report verified none of the figures.
The Business Engineer Lens
Where this idea sits in the Business Engineer library:
The One Question to Ask
- What breaks when the model under us changes?
How This Concept Connects
Layer 3 of 8 · Inference & Context, on the Business Engineer Concept Map
- Model Deprecation constrains Fine-Tuning. When a new base model arrives you have to tune again, and deprecation forces that move on the provider’s schedule.
- Model Deprecation builds on AI Evaluation as Acceptance Test. The defense against deprecation is keeping your own test cases and rerunning them before every switch, an acceptance evaluation.
- Model Deprecation builds on Switching Costs. Deprecation forces a model switch, and the switching-costs lesson says the prompts, tests and connections around the model are the costly part.
- Model Deprecation is an example of One-Sided Terms (lesson unlocks soon). The provider alone decides to retire the model, a rule only one side can change.
- Model Deprecation is an example of Embedded Dependency (lesson unlocks soon). A product built on a rented model relies on a supplier inside it, and retirement exposes that hidden layer.
The Harness Theory
A good harness lets the model be swapped.Business Engineer framework
The Open vs Closed Meta-Framework
Renting closed models means the provider retires versions.
Get the full Concept Map as a free poster.
Related Business Pills
All Business Pills
- The Memory Wall: Why a Faster AI Chip Is Not Faster AI
- Tokens per Watt: What an AI Data Centre Actually Produces
- Why AI Can’t Be Both Instant and Cheap: Latency vs Throughput
- The Model and the Harness: Why Same-Model Products Differ
- Context, Not Capability: Why a Smart AI Model Gives Poor Answers
- Discardable Software: When Code Is Cheap Enough to Throw Away
- Human in the Loop vs Human on the Loop: Supervising AI Agents
- The AI Audit Problem: When Making Work Is Cheaper Than Checking It
- AI Evaluation as Acceptance Test: How to Know It’s Good Enough
- Extensibility Is Control: Who Holds the Power in an AI Product
- RLHF Explained: How an AI Model Learns What People Prefer
- Pretraining Explained: How an AI Model Learns Before Anyone Teaches It
- Fine-Tuning Explained: How to Adapt a General AI Model to One Job
- Tokens Explained: The Unit AI Reads, Writes and Bills In
- Embeddings Explained: How a Machine Compares Meaning
- RAG Explained: How a Model Answers From Your Documents
- AI Hallucination Explained: Why Models State False Things
- Distillation Explained: How a Small Model Learns From a Large One
- Reasoning Models Explained: What Changes When AI Thinks First
- Tool Use Explained: How an AI Model Goes From Text to Action
- Capex and Depreciation Explained: Why Chip Lifetime Drives AI Profits
- Run-Rate Revenue Explained: What an AI Company’s Number Means
- Backlog Explained: Revenue That Is Signed but Not Yet Earned
- Switching Costs Explained: Why It Is Hard to Leave an AI Supplier
- Temperature Explained: The Dial That Sets How Predictable an AI Model Is
- Guardrails Explained: Rules Enforced Around an AI Model, Not Inside It
- Benchmarks Explained: Why a Test Score Is Not Your Own Result
- Agent Memory Explained: How an AI Assistant Remembers You Between Chats
- MCP Explained: The Shared Plug That Connects AI Models to Tools
- Quantization Explained: How a Large AI Model Is Shrunk to Fit
- Parameters Explained: Where an AI Model’s Knowledge Lives
- Scaling Laws Explained: Why AI Labs Keep Building Bigger
- Synthetic Data Explained: When a Model Writes Its Own Training Examples
- Transformers and Attention Explained: How AI Reads Every Word at Once









