A model writes one word at a time, choosing the most probable next word. It is not looking anything up. It is producing text that sounds right. Most of the time, what sounds right is right.
What a Hallucination Is
But when the model does not know, it does not stop. It keeps producing probable words. The result is fluent, specific, and invented. This is called a hallucination: a confident answer with nothing behind it.
A typical case: ask for a legal precedent. The model returns a case name, a court, a year and a quotation, all perfectly formatted, and none of it exists.
Why It Happens
The model is trained to produce an answer, not to say I do not know. And its confidence is the same whether it is recalling a fact or filling a gap.
What Reduces It
It cannot be removed completely, but it can be reduced. Give the model the source documents. Ask it to cite them. Let it say when it is unsure. And check the answers that matter.
A Simple Rule
The more an answer matters, the less it can rest on the model alone. A first draft can tolerate an error. A contract, a diagnosis, or a financial figure cannot.
The Business Engineer framework maps where each part of the AI stack sits and who holds the leverage. These pills are short lessons from the same library.
Gennaro is the creator of FourWeekMBA, which reached about four million business people, comprising C-level executives, investors, analysts, product managers, and aspiring digital entrepreneurs in 2022 alone | He is also Director of Sales for a high-tech scaleup in the AI Industry | In 2012, Gennaro earned an International MBA with emphasis on Corporate Finance and Business Strategy.
Scroll to Top
Discover more from FourWeekMBA
Subscribe now to keep reading and get access to the full archive.
