AI chatbots can't summarize news accurately, says BBC study
The British Broadcasting Corporation’s latest study reveals that AI chatbots distort and mislead when they report the news. Deborah Turness, the CEO of BBC News and Current Affairs, wrote in a blog that AI brings “endless opportunities.” However, companies developing AI tools were “playing with fire.”
“How long will it be before an AI-distorted headline causes significant real-world harm?” she asked.
A BBC study finds 51% of AI answers to questions about the news had "significant issues", and 19% of answers citing BBC content introduced factual errors (@matthew_weaver / The Guardian).
The BBC gave the popular AI chatbots ChatGPT, Copilot, Google Gemini, and Perplexity AI-generated content from the BBC website. Then, it asked them questions about the news. As a result, the AI bots provided answers with “significant inaccuracies” and distortions.
For example, Google Gemini mistakenly stated that “The NHS advises people not to start vaping and recommends that smokers who want to quit should use other methods.” The NHS does not recommend vaping as a way to quit smoking.
Insights from the BBC study on AI news reporting:
- BBC chief Deborah Turness says “AI assistants do not discern between facts and opinion in news coverage.”
- BBC chief Deborah Turness says “AI assistants do not discern between facts and opinion in news coverage.”
- BBC chief Deborah Turness says “AI assistants do not discern between facts and opinion in news coverage.”
Nevertheless, Pete Archer, BBC Program Director for Generative AI, expects more people to use AI assistants. That’s why they should provide audiences with accurate and trustworthy information. The BBC and other publications should have control over how AI companies use their content.
Subscribe to our daily newsletter to stay informed about the latest news and updates.
The tech and media sectors must work together to ensure people can find trustworthy information in the age of AI. Subscribe to our newsletter to stay up to date with developments in the field.
This is an information message We use cookies to enhance your experience. By continuing, you agree to our use of cookies. Learn more here.
