Ban AI apps creating naked images of children, says children's commissioner for England
The children's commissioner for England, Dame Rachel de Souza, is urging the government to implement a prohibition on apps that utilize artificial intelligence (AI) to generate sexually explicit images of children. She emphasized the necessity of a complete ban on apps that enable "nudification," a process where AI is used to manipulate photos of real individuals to make them appear nude. Dame Rachel expressed concern over the unchecked proliferation of such apps, highlighting the severe real-world implications they pose.
AI Tools and Deepfakes
In a recent report, Dame Rachel pointed out that these AI technologies disproportionately target girls and young women, with many applications specifically designed to alter images of female bodies. As a result, girls are refraining from sharing photos or engaging online activities to minimize the risk of being targeted by such tools.
Children are living in fear of potential exploitation by individuals taking advantage of these technologies, which are easily accessible through popular online platforms.
Legal Measures and Concerns
While existing laws prohibit the sharing of explicit deepfake content under the Online Safety Act, Dame Rachel believes that more stringent actions are required. She contends that the current legislation falls short in addressing the broader issue of AI-generated child sexual abuse materials.
The Internet Watch Foundation reported a significant increase in AI-generated child sexual abuse cases, indicating a pressing need for stricter regulations and enforcement mechanisms.
Challenges and Recommendations
Dame Rachel called for a comprehensive ban on nudifying apps, emphasizing the urgent need to safeguard children from the harmful impacts of AI technologies. She also advocated for greater oversight and education regarding these emerging threats, highlighting the importance of aligning legal frameworks with technological advancements.
Paul Whiteman, general secretary of the school leaders' union NAHT, echoed the commissioner's concerns, underscoring the need for proactive review and adaptation of laws to address evolving technological risks.
Media regulator Ofcom's recent implementation of the Children's Code reflects a growing awareness of the need to protect children from online harms, signaling a shift towards more robust safeguarding measures.
Conclusion
As the debate around AI-generated content and child safety intensifies, stakeholders are increasingly acknowledging the critical need for decisive action. By advocating for stricter regulations, enhanced enforcement mechanisms, and proactive education, Dame Rachel and other advocates are striving to create a safer online environment for children.
