AI · Article 11 of 11
Why AI fills gaps with confidence

When an AI doesn't know something, it often guesses instead of saying so. OpenAI's research explains why: the way models are trained and tested rewards a confident guess over an honest "I don't know". For a business, that means a guess about your hours or prices can sound exactly like a fact.
Why it guesses
Imagine a multiple-choice test where a blank answer scores zero and a guess sometimes earns a point. Over time, you learn to always guess. In September 2025, OpenAI published research arguing that language models face the same incentive: the way they're usually trained and scored rewards a confident guess more than admitting uncertainty.1
OpenAI gives a simple example. Ask a model for a birthday it doesn't know. If it guesses, it has one chance in 365 of being right. If it says "I don't know", it scores zero. Over thousands of test questions, the model that guesses looks better on the scoreboard than the careful one.
Its own numbers show the trade-off. In one test, an older OpenAI model got 24% of the answers right and 75% wrong, because it almost never held back. A newer model got 22% right but only 26% wrong, because it said it didn't know in about half of the questions.
Why it matters for your business
The same research says these confident mistakes aren't inevitable: a model can hold back when it isn't sure. But they still happen, and a wrong answer delivered with confidence sounds exactly like a right one.
That's the risk for your business. If your information is missing or inconsistent online, an assistant may fill the gap with something that sounds right: your hours, your prices, the services you offer.
What this means in practice
- Leave fewer gaps. Name, address, hours, prices and services, the same everywhere they appear.
- Keep it current. When something changes, update it everywhere at once, not one place at a time.
- Look now and then. Ask an assistant about your business. If it gets something wrong, fix the source it's drawing from.
The fix isn't to fight the AI. It's to leave it fewer gaps to fill. Ask us how on a free 30-minute call.
Charted and signedNovember 2026 · Alejandro Peñuela
Every claim in this article points to its source.