Business Pill poster: model deprecation

Model Deprecation Explained: What Breaks When the Model Under You Changes

Business Pill · What breaks when the model under you changes

Model deprecation is a provider retiring a model version, so everything built on it has to move. The new model may be better on average and still worse at your task.

A short explainer video, under a minute. The bakery and its ordering assistant are an illustration.

At a glance

What Model Deprecation Is

That is called model deprecation. It means a provider retiring a model version, so everything built on it has to move.

What Can Go Wrong

The new model may be better on average, and still worse at your task.

Why It Matters

The video turns this into one question: what breaks when the model under us changes?

The Short Answer

Picture a bakery that builds its ordering assistant on an AI model, and tunes it for months.

One morning the provider retires that model and swaps in a newer one. The instructions are the same, but the behavior is different.

What Model Deprecation Is

That is called model deprecation. It means a provider retiring a model version, so everything built on it has to move.

What Can Go Wrong

The new model may be better on average, and still worse at your task. Prompts tuned for the old one may misfire. Cost and speed can shift.

The Idea in Parts

The lesson in its own parts

What Model Deprecation Is

That is called model deprecation. It means a provider retiring a model version, so everything built on it has to move.

What Can Go Wrong

The new model may be better on average, and still worse at your task.

The Boring Defense

The defense is boring, and it works. Pin the version.

The Boring Defense

The defense is boring, and it works. Pin the version. Keep your own test cases. Rerun them before every switch.

Why It Matters

The video turns this into one question: what breaks when the model under us changes?

The model under your product is rented. Be ready for the day it is replaced.

The key insight: The model under your product is rented. Be ready for the day it is replaced.

The honest limit

The new model may be better on average, and still worse at your task. Prompts tuned for the old one may misfire. Cost and speed can shift.

Where This Shows Up in AI Business Today

From our news coverage

ThinkingBox: Opus 5.5 and Opus 5 Tie at 241 of 507 Tasks

Two versions of one model family are being compared side by side. In our report on ThinkingBox, the post says Claude Opus 5.5 and Claude Opus 5 each pass 241 of 507 tasks on all 20 attempts, at estimated costs of $7.80 and $13.30 per dependable task.

From our news coverage

The costs are the authors’ estimates at list rates, and our report verified none of the figures.

The Business Engineer Lens

Where this idea sits in the Business Engineer library:

Business Engineer Framework

The Map of AI

The Business Engineer framework maps where each part of the AI stack sits and who holds the leverage. These pills are short lessons from the same library.

Explore the Map of AI →

The One Question to Ask

  1. What breaks when the model under us changes?

How This Concept Connects

Layer 3 of 8 · Inference & Context, on the Business Engineer Concept Map

Fine-TuningAI Evaluation as AcceptancSwitching CostsOne-Sided TermsEmbedded DependencyModel Deprecation
  • Model Deprecation constrains Fine-Tuning. When a new base model arrives you have to tune again, and deprecation forces that move on the provider’s schedule.
  • Model Deprecation builds on AI Evaluation as Acceptance Test. The defense against deprecation is keeping your own test cases and rerunning them before every switch, an acceptance evaluation.
  • Model Deprecation builds on Switching Costs. Deprecation forces a model switch, and the switching-costs lesson says the prompts, tests and connections around the model are the costly part.
  • Model Deprecation is an example of One-Sided Terms (lesson unlocks soon). The provider alone decides to retire the model, a rule only one side can change.
  • Model Deprecation is an example of Embedded Dependency (lesson unlocks soon). A product built on a rented model relies on a supplier inside it, and retirement exposes that hidden layer.
Business Engineer framework
The Harness Theory
A good harness lets the model be swapped.
Business Engineer framework
The Open vs Closed Meta-Framework
Renting closed models means the provider retires versions.
See all 141 concepts on one map
Get the full Concept Map as a free poster.
Get the map

Related Business Pills

Business PillSwitching Costs Explained: Why It Is Hard to Leave an AI SupplierWhy is it so hard to leave a technology supplier? Switching costs: four kinds, a worked example with round numbers, what changes in AI, and how a buyer can lower them.Business PillBenchmarks Explained: Why a Test Score Is Not Your Own ResultWhy a high test score does not tell you which AI model does your job: benchmarks, their two limits, a managerโ€™s own 20-case test, and the one question to ask.Business PillModel Routing Explained: Sending Each Question to the Right AI ModelWhat model routing is: sending each request to the cheapest model that can handle it, easy questions to a small model and hard ones to a big one, the risk of a wrong turn, and the one question to ask.Business PillOpen Weights Explained: Rent the Model or Run It YourselfWhat open weights means in AI: a model whose parameters are published so anyone can run it, how that differs from a closed model, what it costs to run, and the one question to ask.

All Business Pills

Scroll to Top
FourWeekMBA