Business Pill 26 · How a machine measures meaning
Embeddings turn text into a position on a map of meaning, so a machine can measure how close two pieces of text are.
A short explainer video. The numbers in it are round numbers for illustration.
The Short Answer
Computers are good at comparing exact words. But meaning is not about exact words. Car and automobile share almost no letters, yet they mean the same thing. And bank can mean money, or the side of a river.
A Map of Meaning
The solution is to turn text into numbers. A model reads a piece of text and produces a long list of numbers. Think of that list as coordinates, a position on a map.
On that map, things with similar meaning sit close together. Car lands next to automobile. Invoice lands near payment. And a question lands near the text that answers it. That list of numbers is called an embedding.
What It Powers
This one idea powers a great deal: search that understands what you meant, not just what you typed; recommendations; grouping thousands of documents by topic; and finding the right page to hand to a model before it answers.
Why It Matters
For a business it means your documents can be found by meaning. But only if they have been embedded first. And the quality of the map depends on the model that drew it.
Three Questions to Ask
- Which of our content can be searched by meaning?
- Which model creates the embedding?
- How do we check that the right things land close together?
How This Concept Connects
Layer 3 of 8 · Inference & Context, on the Business Engineer Concept Map
- RAG builds on Embeddings. RAG’s retrieve step searches documents for passages closest to the question, the search-by-meaning that embeddings power.
- Embeddings builds on Transformers and Attention. Both lessons use the word bank to show meaning depends on context; embeddings turn that meaning into coordinates on a map.
The Nine Layers of AI
Embeddings sit in the data/retrieval layer of the stack.
Get the full Concept Map as a free poster.
More Business Pills
- The Memory Wall: Why a Faster AI Chip Is Not Faster AI
- Tokens per Watt: What an AI Data Centre Actually Produces
- Why AI Can’t Be Both Instant and Cheap: Latency vs Throughput
- The Model and the Harness: Why Same-Model Products Differ
- Context, Not Capability: Why a Smart AI Model Gives Poor Answers
- Discardable Software: When Code Is Cheap Enough to Throw Away
- Human in the Loop vs Human on the Loop: Supervising AI Agents
- The AI Audit Problem: When Making Work Is Cheaper Than Checking It
- AI Evaluation as Acceptance Test: How to Know It’s Good Enough
- Extensibility Is Control: Who Holds the Power in an AI Product
- RLHF Explained: How an AI Model Learns What People Prefer
- Pretraining Explained: How an AI Model Learns Before Anyone Teaches It
- Fine-Tuning Explained: How to Adapt a General AI Model to One Job
- Tokens Explained: The Unit AI Reads, Writes and Bills In
- RAG Explained: How a Model Answers From Your Documents
- AI Hallucination Explained: Why Models State False Things
- Distillation Explained: How a Small Model Learns From a Large One
- Reasoning Models Explained: What Changes When AI Thinks First
- Tool Use Explained: How an AI Model Goes From Text to Action
- Capex and Depreciation Explained: Why Chip Lifetime Drives AI Profits
- Run-Rate Revenue Explained: What an AI Company’s Number Means
- Backlog Explained: Revenue That Is Signed but Not Yet Earned
- Switching Costs Explained: Why It Is Hard to Leave an AI Supplier
- Temperature Explained: The Dial That Sets How Predictable an AI Model Is
- Guardrails Explained: Rules Enforced Around an AI Model, Not Inside It
- Benchmarks Explained: Why a Test Score Is Not Your Own Result
- Agent Memory Explained: How an AI Assistant Remembers You Between Chats
- MCP Explained: The Shared Plug That Connects AI Models to Tools
- Quantization Explained: How a Large AI Model Is Shrunk to Fit
- Parameters Explained: Where an AI Model’s Knowledge Lives
- Scaling Laws Explained: Why AI Labs Keep Building Bigger
- Synthetic Data Explained: When a Model Writes Its Own Training Examples
- Transformers and Attention Explained: How AI Reads Every Word at Once









