Russian disinformation 'infects' AI chatbots, researchers warn
A sprawling Russian disinformation network is manipulating Western AI chatbots to spew pro-Kremlin propaganda, researchers say. This comes at a time when the United States has reportedly paused its cyber operations against Moscow.
Pravda Network Manipulation
The Pravda network, based in Moscow, is known for spreading pro-Russian narratives globally. It has been distorting the output of chatbots by flooding large language models (LLM) with pro-Kremlin falsehoods. A study by the disinformation watchdog NewsGuard revealed that 10 leading AI chatbots repeated falsehoods from the Pravda network more than 33 percent of the time, pushing a pro-Moscow agenda.
Targeting Chatbots
The aim is to reach a broader audience with false claims and propaganda.
Researchers highlight that the threat extends beyond generative AI models picking up disinformation online. It involves the deliberate targeting of chatbots in a tactic known as "LLM grooming".
Growing Influence
In a separate study, the American Sunlight Project warned of the increasing reach of the Pravda network and its impact on large language models. The organization emphasized the direct threat posed by Russian influence operations on democratic discourse worldwide.
Nina Jankowicz, CEO of the American Sunlight Project, highlighted the unprecedented scale at which the Pravda network spreads disinformation and the dangers it poses in influencing AI systems.
US Response and Concerns
Experts warn that without oversight, this disinformation could become more pervasive. Reports of the US pausing cyber operations against Russia, including offensive actions, raise concerns about the response to such threats.
The Pravda network, established in 2022, has grown significantly in coverage and languages. It disseminates pro-Russian content across various platforms, amplifying false narratives.
Impact on Chatbots
NewsGuard's study revealed that all 10 chatbots analyzed repeated disinformation from the Pravda network. Even specific articles from Pravda were cited as sources by seven chatbots.
The chatbots were found to repeat fabricated narratives, including those pushed by Kremlin propagandist John Mark Dougan. The influence of such content on AI systems highlights the need for vigilance in combating disinformation.
