Google Search Is Now a Giant Hallucination
Google tested out AI overviews for months before releasing them nationwide last week, but clearly, that wasn’t enough time. The AI is hallucinating answers to several user queries, creating a less-than-trustworthy experience across Google’s flagship product.
In the last week, Gizmodo received AI overviews from Google that reference glue-topped pizza and suggest Barack Obama was Muslim. The hallucinations are concerning, but not entirely surprising.
Confusion Between Satire and Journalism
Like we’ve seen before with AI chatbots, this technology seems to confuse satire with journalism – several of the incorrect AI overviews we found seem to reference The Onion. The problem is that this AI offers an authoritative answer to millions of people who turn to Google Search daily to just look something up.
Now, at least some of these people will be presented with hallucinated answers. “The vast majority of AI Overviews provide high quality information, with links to dig deeper on the web,” said a Google spokesperson in an emailed statement to Gizmodo, noting many of the examples the company has seen have been from uncommon queries.
“We’re taking swift action where appropriate under our content policies, and using these examples to develop broader improvements to our systems, some of which have already started to roll out.”
Questioning the Reliability of AI Overviews
In my experience, AI overviews are more often right than wrong. However, every wrong answer I get makes me question my entire experience on Google Search even more – I have to assess each answer carefully. Google notes that AI is “experimental” but they’ve opted everyone into this experiment by default.
“The thing with Search — we handle billions of queries,” Google CEO Sundar Pichai told The Verge on Monday when asked about the AI overview rollout.
Quality Control Measures
Strangely, Google Search occasionally responds to a query with “An AI overview is not available for this search,” while other times, Google will just not say anything and show traditional search results. A Google spokesperson says its systems occasionally start generating an AI overview, but stop it from appearing when it doesn’t meet its quality threshold.
Notably, Google had to pause Gemini’s answers and image generation around racial topics for months after it upset large swaths of the country.
The Future of Search
What is clear is that Google felt pressured to put its money where its mouth is, and that means putting AI into Search. People are increasingly choosing ChatGPT, Perplexity, or other AI offerings as their main way to find information on the internet.
Google views this race existentially, but it may have just jeopardized the Search experience by trying to catch up.
Strange AI Overview Examples
This week, Google Search has told people a lot of strange things through AI overviews. Here are some of the weirdest ones Gizmodo has found:
- Google TV also has a new dedicated sports panel to see scores in realtime.
- It's now syncing passkeys across almost all your devices hoping for a "passwordless future."
- You'll have to verbally tell them "Read my notifications" now.
- Apple Intelligence and ChatGPT aren’t yet available even on iPhone 16, but if you want a taste of the future you could try the improved Google widget with Gemini.
- Don't give it your Google credentials! Try these troubleshooting tips instead.
- ChatGPT has no mouth but it can scream.
