Gross Margin Explained: What an AI Company Keeps From Each Dollar

Gross Margin Explained: What an AI Company Keeps From Each Dollar

Business Pill · What a company keeps

Gross margin is the share of revenue that remains after the direct cost of delivering the product. In the video’s example, the software company keeps 90% and the AI company keeps 50%.

A short explainer video, under a minute. The two companies and their figures are an illustration.

At a glance

What Gross Margin Is

What is left has a name. It is called gross margin: the share of revenue that remains after the direct cost of delivering the product.

What the Remainder Has to Pay For

The remainder has to pay for research, for sales, and for profit.

Why It Matters

The video turns this into one question: what is left from each dollar after the cost of the answers?

The Short Answer

Two companies each sell a subscription for a hundred dollars. For the software company, serving that customer costs ten dollars.

For the AI company, every answer burns chips. Serving the same customer costs fifty.

What Gross Margin Is

What is left has a name. It is called gross margin: the share of revenue that remains after the direct cost of delivering the product.

This publication’s own arithmetic: a hundred dollars minus ten dollars is ninety, so the software company keeps 90%. A hundred minus fifty is fifty, so the AI company keeps 50%.

Bar chart: the software company's gross margin is 90% and the AI company's is 50% in the video's illustration
The video’s illustration. The percentages follow from a $100 subscription and costs of $10 and $50.

What the Remainder Has to Pay For

The remainder has to pay for research, for sales, and for profit.

Out of the same hundred-dollar subscription, the software company has ninety dollars left for those three things and the AI company has fifty.

The Idea on One Board

What Gross Margin Is

The software company

For the software company, serving that customer costs ten dollars.

The AI company

For the AI company, every answer burns chips. Serving the same customer costs fifty.

The Twist: Cost Grows With Use

In AI, the cost grows with use. The video’s example is a heavy user who asks ten thousand questions in a day, with a note on screen that reads pays $100, costs $140.

A heavy user can cost more than they pay. This publication’s own arithmetic: a hundred and forty minus a hundred is forty, so that customer costs forty more than the subscription brings in.

Why It Matters

The video turns this into one question: what is left from each dollar after the cost of the answers?

Revenue is what comes in. Gross margin is what you keep.

The key insight: Revenue is what comes in. Gross margin is what you keep.

The honest limit

In AI, the cost grows with use.

A heavy user can cost more than they pay.

Where This Shows Up in AI Business Today

From our news coverage

Anthropic’s $518B Leak: Google $111.1B, Amazon $110B, 80% Locked

Our report on Anthropic’s reported prospectus says that, as Reuters’ account of a confidential prospectus is relayed, Anthropic expects to spend at least $518 billion over a decade on compute from six partners, with about 80% non-cancellable or payable regardless of usage. We verified none of it independently. What is left after the cost of the answers is the margin this lesson describes.

The Business Engineer Lens

Where this idea sits in the Business Engineer library:

Business Engineer Framework

The Map of AI

The Business Engineer framework maps where each part of the AI stack sits and who holds the leverage. These pills are short lessons from the same library.

Explore the Map of AI →

The One Question to Ask

  1. What is left from each dollar after the cost of the answers?

How This Concept Connects

Layer 6 of 8 · Pricing & Unit Economics, on the Business Engineer Concept Map

  • Inference drives the cost of Gross Margin. Inference is paid on every answer, so serving the same customer costs an AI company far more than a software company.
  • Model Routing drives the cost of Gross Margin. Sending simple questions to a small model cuts the cost of each answer, the direct cost gross margin subtracts.
  • Operating Leverage builds on Gross Margin. Operating leverage depends on costs staying flat as sales grow, and gross margin shows how much of each sale costs grow with.
  • Customer Acquisition Cost contrasts with Gross Margin. CAC is the one-off price of winning a customer; gross margin is what each month’s revenue keeps to repay it.
  • Prompt Caching (lesson unlocks soon) drives the cost of Gross Margin. Not paying twice to read the same page lowers the direct cost of each answer, the cost gross margin subtracts.
  • Take Rate (lesson unlocks soon) contrasts with Gross Margin. A take rate is a share, not a profit: the market still pays for stalls and staff, as gross margin subtracts direct cost.
Business Engineer framework
Tokenomics: The Economics of AI
Token costs set AI gross margins.
Business Engineer framework
The Subsidized AGI Economy
Margins under subsidised AI pricing.
See all 141 concepts on one map
Get the full Concept Map as a free poster.
Get the map

Related Business Pills

Business PillRun-Rate Revenue Explained: What an AI Company’s Number MeansWhat does it mean when an AI company reports its revenue run rate? A worked example, how it differs from annual revenue and ARR, and three questions to ask.Business PillCapex and Depreciation Explained: Why Chip Lifetime Drives AI ProfitsWhy the lifetime of a chip matters so much to AI profits: capital expenditure, depreciation, a worked example with round numbers, and what to ask.Business PillBacklog Explained: Revenue That Is Signed but Not Yet EarnedWhat is a backlog and why do AI companies report such large ones? Signed but undelivered revenue, remaining performance obligations, a worked example and risks.Business PillInference Explained: The Cost Paid on Every AI AnswerWhy the cost of AI does not end when training ends: inference, the cost paid on every answer, how it compares with training, and the one question to ask.

All Business Pills

Scroll to Top
FourWeekMBA