What if the chatbot makes it up? How to stop AI hallucinations on your website

A woman examines a book with a magnifying glass next to her laptop

It’s probably the most common fear when people talk about putting an AI chatbot on a website: that it tells a customer the wrong price, the wrong opening hours or a condition that doesn’t exist. And the fear is well founded, because AI does do this. What not everyone knows is that it can be solved.

Why an AI makes things up

Language models, like the ones behind AI assistants, have learned to write text that sounds right. When you ask them something, they generate the most likely answer based on everything they’ve read. If they don’t have the information, they often don’t say “I don’t know”: they write something plausible. This is called a hallucination, and it’s why a general-purpose assistant can tell you something false with complete confidence.

If you ask a generic AI how much a scale and polish costs at your clinic, it has no way of knowing. It will give you a price that sounds reasonable, but it won’t be yours.

Books, a notebook and a magnifying glass on a table

The fix: it can only answer with your information

The technique that solves this is called retrieval-augmented generation, or RAG. The idea is simple: before writing the answer, the system searches your business’s information for the passages that deal with what you’ve been asked. Then the AI writes the answer using only those passages.

If it searches and finds nothing, the right response is to admit it doesn’t know and offer another route, such as leaving a phone number or talking to someone on the team, rather than improvising.

Answers you can check

There’s one more step that makes the difference: every answer says where it comes from. Just as a good article cites its sources, a good assistant should link to the page on your website where the information is. That way the customer can check it if they want, and you can see at any time why it answered the way it did.

What still depends on you

No system can answer well with bad information. If your website says you open at nine and you actually open at ten, the assistant will say nine. That’s why the information needs to be up to date and the assistant needs to update itself when you change your website. And it’s why it’s worth checking now and then what people are asking.

How OX·IA does it

At OX·IA the assistant has been built this way from the start. It only answers with what’s on your website and what you teach it; each detail carries a number that links to the exact page and highlights the sentence it comes from. If it can’t find the answer, it says so politely, offers your contact details and logs the question in your dashboard so you can teach it the answer in a moment. Every night it checks your website and learns what has changed, and if you use WordPress, our plugin teaches it straight away.

If you want to see how it answers with your own website, try it free and ask it something you know isn’t there. That’s the best way to find out.

Would you rather talk to a person?

Give us a call and we’ll talk you through it, no strings attached.