Google is rolling out its Gemini AI chatbot to kids under 13. It's a risky move
Google has announced it will roll out its Gemini artificial intelligence (AI) chatbot to children under the age of 13. The launch will begin within the next week in the United States and Canada, with a later launch in Australia planned for later this year. Access to the chatbot will only be available through Google’s Family Link accounts.
The Risks Involved
Despite the convenience, this development comes with major risks. Even if children are prohibited from using social media platforms, parents will still need to monitor new technologies to ensure their children's safety. Urgent measures need to be implemented, such as a digital duty of care for tech companies like Google.
Parental Controls and Privacy Concerns
Google’s Family Link accounts empower parents to manage content and app access, including platforms like YouTube. However, creating a child's account requires parents to provide personal details, which can raise privacy concerns. Google assures that children's data will not be utilized to train the AI system.
Chatbot Functionality
Chatbot access is enabled by default, necessitating parents to actively disable the feature to restrict access. Children can engage with the chatbot for text responses or image creation. It's crucial to acknowledge that the system may make errors, warranting content quality evaluation.
Challenges in Content Evaluation
Due to the AI's ability to generate responses based on queries, it's vital for children to differentiate between information retrieved from search engines and that created by AI tools. Studies indicate that individuals of all ages, including professionals like lawyers, can be misled by AI-generated content.
Ensuring Child Safety Online
As children become more tech-savvy, relying solely on built-in safeguards is insufficient. Parents must review generated content, educate their children on digital tools' workings, and verify content accuracy. The eSafety Commission has issued warnings on AI chatbots' potential risks, emphasizing the importance of educating children on critical thinking and online safety.
Implications and the Need for Regulation
The rollout of Gemini's AI chatbot coincides with Australia's social media ban for children under 16, underscoring the broader risks of online engagement. Parents and children require education on safe digital tool usage. Australia must revisit its proposed digital duty of care legislation to hold tech companies accountable for addressing harmful content.
This article is republished from The Conversation.
