Russian disinformation 'infects' AI chatbots, researchers warn | News ...
Researchers have raised concerns about the infiltration of Russian disinformation into AI chatbots, cautioning about the potential impact on the spread of propaganda.
Manipulating AI Chatbots
A sprawling Russian disinformation network known as the Pravda network has been identified as manipulating Western AI chatbots to disseminate pro-Kremlin propaganda. This operation, based in Moscow, aims to distort the output of chatbots by inundating large language models (LLM) with false information supportive of the Kremlin's agenda.
A study conducted by NewsGuard on 10 prominent AI chatbots revealed that over 33 percent of the time, these chatbots repeated falsehoods originating from the Pravda network. This phenomenon highlights the deliberate effort to influence a broader audience through chatbots, a tactic referred to as "LLM grooming."
Expanding Influence
The American Sunlight Project also warned about the expanding reach of the Pravda network, emphasizing the potential consequences of its pro-Russian content saturating the training data of large language models. As Russian influence operations advance, they pose a significant threat to democratic discourse worldwide, according to experts.
Notably, the Pravda network, which emerged after Russia's invasion of Ukraine in 2022, has grown substantially, covering 49 countries and various languages. This network aggregates content from sources like Russian state media and pro-Kremlin influencers, amplifying millions of articles containing pro-Russian narratives.
Concerns and Warnings
The findings of these studies underscore the urgent need for oversight and vigilance against the proliferation of disinformation, particularly in AI systems. With reports of the US pausing cyber operations against Russia and ongoing geopolitical tensions, the threat of misinformation influencing AI responses remains a critical issue.
Conclusion
In conclusion, the interplay between disinformation networks and AI technologies poses a multifaceted challenge to global information ecosystems. Addressing this challenge necessitates collaborative efforts from researchers, policymakers, and tech companies to uphold the principles of truth and transparency in the digital age.
Original article published on doc.afp.com, part of the BLOX Digital Content Exchange.
