Embeddings Explained: How a Machine Compares Meaning

Business Pill 26 · How a machine measures meaning

Embeddings turn text into a position on a map of meaning, so a machine can measure how close two pieces of text are.

A short explainer video. The numbers in it are round numbers for illustration.

The Short Answer

Computers are good at comparing exact words. But meaning is not about exact words. Car and automobile share almost no letters, yet they mean the same thing. And bank can mean money, or the side of a river.

A Map of Meaning

The solution is to turn text into numbers. A model reads a piece of text and produces a long list of numbers. Think of that list as coordinates, a position on a map.

On that map, things with similar meaning sit close together. Car lands next to automobile. Invoice lands near payment. And a question lands near the text that answers it. That list of numbers is called an embedding.

What It Powers

This one idea powers a great deal: search that understands what you meant, not just what you typed; recommendations; grouping thousands of documents by topic; and finding the right page to hand to a model before it answers.

Why It Matters

For a business it means your documents can be found by meaning. But only if they have been embedded first. And the quality of the map depends on the model that drew it.

Three Questions to Ask

  1. Which of our content can be searched by meaning?
  2. Which model creates the embedding?
  3. How do we check that the right things land close together?

How This Concept Connects

Layer 3 of 8 · Inference & Context, on the Business Engineer Concept Map

  • RAG builds on Embeddings. RAG’s retrieve step searches documents for passages closest to the question, the search-by-meaning that embeddings power.
  • Embeddings builds on Transformers and Attention. Both lessons use the word bank to show meaning depends on context; embeddings turn that meaning into coordinates on a map.
Business Engineer framework
The Nine Layers of AI
Embeddings sit in the data/retrieval layer of the stack.
See all 141 concepts on one map
Get the full Concept Map as a free poster.
Get the map

More Business Pills

Scroll to Top

Discover more from FourWeekMBA

Subscribe now to keep reading and get access to the full archive.

Continue reading

FourWeekMBA