Pixel 9 AI image generation is a huge problem that Google needs to fix
There’s no question the Pixel 9 phones are Google’s best possible AI hardware right now. Google couldn’t wait to launch the Pixel 9 models, even if that meant running Android 14 out of the box instead of the newest Android 15 release. Google had to prove that its Gemini AI features are ready for mass consumption right now. By launching now, Google got ahead of OpenAI’s ChatGPT voice mode upgrade and the debut of Apple Intelligence on the iPhone 16.
A Golden Opportunity for Google
The current smartphone landscape, combined with recent advancements in AI, gave Google a golden opportunity it might not encounter again. We’re at a point in time when hundreds of millions of iPhones out in the wild that will get the iOS 18 upgrade will not be capable of running any Apple AI features. Plus, when Apple Intelligence does roll out to the iPhone 16 series and iPhone 15 Pro models, it won’t match the full capabilities of Gemini.
Challenges Faced by Google
Moving at break-neck speeds is challenging even for Google, however. The company finds itself in a position where it has to fix its AI again. The Pixel 9’s Pixel Studio app can generate questionable AI content. Moreover, the Reimagine feature in the Photos app can also be abused.
Is it as bad as AI Overviews in Google Search thinking people should eat glue on pizza? Yes and no.
Concerns with AI Content Generation
AI Overviews generating factually incorrect information in Google Search was a big problem because it ruined the reliability of Google’s best product. The AI’s inability to separate jokes on the web from factual information allowed recipes for pizza with glue to appear at the top of Search results. Google had to scramble and fix the issues.
Pixel Studio and the Reimagine feature might not hurt Google’s brand and reputation quite as much as AI Overviews. But they can be used to generate troubling content that can manipulate people.
Questionable Content Generation by Pixel Studio
When Google unveiled the Pixel 9 phones, it was mentioned that the Pixel Studio functionality would let users generate images by instructing the AI. However, the Pixel Studio has been found to produce questionable content, including copyrighted materials and offensive prompts.
The Pixel 9 has new AI tools to generate images, and reviews have shown the AI can generate questionable/offensive content.
Digital Trends produced such imagery with the following prompts:
Pixel Studio produced images for each of these prompts. This shouldn’t be possible with any image generator, let alone any that Google makes. Each prompt contains copyrighted content that’s paired with offensive prompts. Google clearly doesn’t have guardrails in place to avoid such abuse.
Google mentioned that they are working to fix these issues and have policies in place to prevent abuse of these AI tools.
Issues with Reimagine Feature
The Reimagine feature in Google Photos allows users to completely alter images, which can lead to the addition of troubling elements like car wrecks, drug paraphernalia, etc. This can be easily abused to manipulate public opinion, posing a significant concern.
Despite the advancements in AI technology, Google does not visibly mark AI-generated images, which can lead to misinformation spreading without clarity on the authenticity of the content.
Google needs to take steps to address the issues with both Pixel Studio and the Reimagine feature to prevent the abuse of these AI capabilities.
