Google Now Lets Gemini AI To See Through Your Phone's Camera ...
While Apple struggles to make its AI better for iPhone users, Google continues to flaunt its Gemini AI prowess and add new ability. The company had demoed its Project Astra feature at the I/O 2024 and now Gemini AI is getting these tools packed into the same app that is available on smartphones.
New Abilities of Gemini AI
Astra is a new-gen AI assistant that is now giving Gemini the power to read and see everything through your phone’s camera. The feature is gradually coming to all Gemini users and some of them have even tried out the new Gemini ability for Android users. Google is using the camera on your phone to guide the AI assistant to help you understand the things near you. It can even read a code written on a PC and help you determine its purpose or solve the complex code as well.

Location Assistance and Privacy Concerns
That’s not all, you can point the camera to the street and ask the AI assistant to tell you where you are located and get more localised details if indeed. It is obvious that Gemini Live will be the carrier of these new abilities and you will need a Pixel phone to try out the see-through camera AI tool from the company. Google is calling it “Share -screen with live" and the demos available on the internet this month give us a clear idea about how the AI feature will work on mobile devices.
Comparison with Other AI Tools
OpenAI has a similar tool available that works on ChatGPT 4o version but Google’s AI feature will be widely available, that too for free with some limits. Some of the high-end features on Gemini needs the Google One AI Premium plan that costs Rs 1,950 per month but you can get it for free with select Pixel models and other brands available in the market.

Future Implications of Astra
Project Astra was expected to roll out for the end users around March this year and it seems Google is close to matching the deadline. This new AI tool feels ideal for devices like smart glasses, something that Google had in its armoury much before the market was ready for it. In fact, Sergey Brin, Google Co-founder has previously mentioned that AI is the “perfect hardware" for the glasses, referring to the applications that the technology offers for the smart wearable and Astra could be the gateway for its growth in this space.