Top AI assistants misrepresent news content, study finds

A joint study by the European Broadcasting Union (EBU) and the BBC revealed that leading AI assistants, including OpenAI's ChatGPT, Microsoft's Copilot, Google's Gemini, and Perplexity, significantly misrepresent news content, with 45% of 3,000 responses containing at least one major issue and 81% exhibiting some form of problem. The research highlighted widespread sourcing errors, notably 72% for Google's Gemini, and 20% accuracy issues, raising concerns about the erosion of public trust as these platforms increasingly replace traditional news sources. This underscores growing risks to information reliability and calls for enhanced accountability from AI developers, with potential implications for regulatory scrutiny and the broader information ecosystem.

Analysis

A recent study by the European Broadcasting Union (EBU) and the BBC reveals significant reliability issues with leading AI assistants, including OpenAI's ChatGPT, Microsoft's Copilot (MSFT), Google's Gemini (GOOGL, GOOG), and Perplexity, when responding to news queries. The research found that 45% of 3,000 responses contained at least one significant issue, with 81% exhibiting some form of problem, underscoring a broad challenge in AI-driven information dissemination. This is particularly concerning as 7% of online news consumers and 15% of those under 25 already use AI assistants for news.

The study identified critical flaws, including accuracy issues in 20% of responses, often involving outdated information or factual errors like the incorrect reporting of Pope Francis's death. More notably, 33% of responses showed serious sourcing errors, with Google's Gemini (GOOGL, GOOG) exhibiting significant sourcing problems in 72% of its responses, substantially higher than its competitors which were below 25%. This disparity highlights a particular vulnerability for Google in this domain.

These findings carry a strongly negative sentiment and cautious tone for the sector, with the EBU warning that such misrepresentation could undermine public trust and democratic participation. The call for AI companies to improve accountability and response quality suggests potential for increased regulatory scrutiny, aligning with the "Regulation & Legislation" theme. This situation poses a material risk to the reputation and adoption trajectory of AI platforms in critical information sectors.

Key Decisions for Investors

• Investors should closely monitor regulatory developments and potential legislative actions stemming from concerns over AI accuracy and accountability, particularly impacting major tech firms.
• Evaluate the commitment and progress of AI developers like Google (GOOGL, GOOG) and Microsoft (MSFT) in addressing identified accuracy and sourcing deficiencies, as these issues could influence user adoption and competitive positioning.
• Consider the potential for traditional, verified news sources to regain trust and market share if AI reliability concerns persist, impacting media sector dynamics.