Business Pill · What a company keeps
Gross margin is the share of revenue that remains after the direct cost of delivering the product. In the video’s example, the software company keeps 90% and the AI company keeps 50%.
A short explainer video, under a minute. The two companies and their figures are an illustration.
At a glance
What Gross Margin Is
What is left has a name. It is called gross margin: the share of revenue that remains after the direct cost of delivering the product.
What the Remainder Has to Pay For
The remainder has to pay for research, for sales, and for profit.
Why It Matters
The video turns this into one question: what is left from each dollar after the cost of the answers?
The Short Answer
Two companies each sell a subscription for a hundred dollars. For the software company, serving that customer costs ten dollars.
For the AI company, every answer burns chips. Serving the same customer costs fifty.
What Gross Margin Is
What is left has a name. It is called gross margin: the share of revenue that remains after the direct cost of delivering the product.
This publication’s own arithmetic: a hundred dollars minus ten dollars is ninety, so the software company keeps 90%. A hundred minus fifty is fifty, so the AI company keeps 50%.

What the Remainder Has to Pay For
The remainder has to pay for research, for sales, and for profit.
Out of the same hundred-dollar subscription, the software company has ninety dollars left for those three things and the AI company has fifty.
The Idea on One Board
What Gross Margin Is
The software company
For the software company, serving that customer costs ten dollars.
The AI company
For the AI company, every answer burns chips. Serving the same customer costs fifty.
The Twist: Cost Grows With Use
In AI, the cost grows with use. The video’s example is a heavy user who asks ten thousand questions in a day, with a note on screen that reads pays $100, costs $140.
A heavy user can cost more than they pay. This publication’s own arithmetic: a hundred and forty minus a hundred is forty, so that customer costs forty more than the subscription brings in.
Why It Matters
The video turns this into one question: what is left from each dollar after the cost of the answers?
Revenue is what comes in. Gross margin is what you keep.
The key insight: Revenue is what comes in. Gross margin is what you keep.
Where This Shows Up in AI Business Today
From our news coverage
Anthropic’s $518B Leak: Google $111.1B, Amazon $110B, 80% Locked
Our report on Anthropic’s reported prospectus says that, as Reuters’ account of a confidential prospectus is relayed, Anthropic expects to spend at least $518 billion over a decade on compute from six partners, with about 80% non-cancellable or payable regardless of usage. We verified none of it independently. What is left after the cost of the answers is the margin this lesson describes.
The Business Engineer Lens
Where this idea sits in the Business Engineer library:
The One Question to Ask
- What is left from each dollar after the cost of the answers?
How This Concept Connects
Layer 6 of 8 · Pricing & Unit Economics, on the Business Engineer Concept Map
- Inference drives the cost of Gross Margin. Inference is paid on every answer, so serving the same customer costs an AI company far more than a software company.
- Model Routing drives the cost of Gross Margin. Sending simple questions to a small model cuts the cost of each answer, the direct cost gross margin subtracts.
- Operating Leverage builds on Gross Margin. Operating leverage depends on costs staying flat as sales grow, and gross margin shows how much of each sale costs grow with.
- Customer Acquisition Cost contrasts with Gross Margin. CAC is the one-off price of winning a customer; gross margin is what each month’s revenue keeps to repay it.
- Prompt Caching (lesson unlocks soon) drives the cost of Gross Margin. Not paying twice to read the same page lowers the direct cost of each answer, the cost gross margin subtracts.
- Take Rate (lesson unlocks soon) contrasts with Gross Margin. A take rate is a share, not a profit: the market still pays for stalls and staff, as gross margin subtracts direct cost.
Tokenomics: The Economics of AI
Token costs set AI gross margins.Business Engineer framework
The Subsidized AGI Economy
Margins under subsidised AI pricing.
Get the full Concept Map as a free poster.
Related Business Pills
All Business Pills
- The Memory Wall: Why a Faster AI Chip Is Not Faster AI
- Tokens per Watt: What an AI Data Centre Actually Produces
- Why AI Can’t Be Both Instant and Cheap: Latency vs Throughput
- The Model and the Harness: Why Same-Model Products Differ
- Context, Not Capability: Why a Smart AI Model Gives Poor Answers
- Discardable Software: When Code Is Cheap Enough to Throw Away
- Human in the Loop vs Human on the Loop: Supervising AI Agents
- The AI Audit Problem: When Making Work Is Cheaper Than Checking It
- AI Evaluation as Acceptance Test: How to Know It’s Good Enough
- Extensibility Is Control: Who Holds the Power in an AI Product
- RLHF Explained: How an AI Model Learns What People Prefer
- Pretraining Explained: How an AI Model Learns Before Anyone Teaches It
- Fine-Tuning Explained: How to Adapt a General AI Model to One Job
- Tokens Explained: The Unit AI Reads, Writes and Bills In
- Embeddings Explained: How a Machine Compares Meaning
- RAG Explained: How a Model Answers From Your Documents
- AI Hallucination Explained: Why Models State False Things
- Distillation Explained: How a Small Model Learns From a Large One
- Reasoning Models Explained: What Changes When AI Thinks First
- Tool Use Explained: How an AI Model Goes From Text to Action
- Capex and Depreciation Explained: Why Chip Lifetime Drives AI Profits
- Run-Rate Revenue Explained: What an AI Company’s Number Means
- Backlog Explained: Revenue That Is Signed but Not Yet Earned
- Switching Costs Explained: Why It Is Hard to Leave an AI Supplier
- Temperature Explained: The Dial That Sets How Predictable an AI Model Is
- Guardrails Explained: Rules Enforced Around an AI Model, Not Inside It
- Benchmarks Explained: Why a Test Score Is Not Your Own Result
- Agent Memory Explained: How an AI Assistant Remembers You Between Chats
- MCP Explained: The Shared Plug That Connects AI Models to Tools
- Quantization Explained: How a Large AI Model Is Shrunk to Fit
- Parameters Explained: Where an AI Model’s Knowledge Lives
- Scaling Laws Explained: Why AI Labs Keep Building Bigger
- Synthetic Data Explained: When a Model Writes Its Own Training Examples
- Transformers and Attention Explained: How AI Reads Every Word at Once








