Gemini Live's background mode and app extensions could blow ...
During Google I/O 2024, the tech giant previewed Gemini Live, a unique version of the AI on mobile capable of holding “natural conversations.” This AI, known as Gemini, allows users to engage in two-way dialogues, similar to interacting with Siri.
Background Mode
Recently, strings of code referencing Gemini Live were discovered in a Google app beta. The code reveals a “background mode” feature that enables users to continue conversations with the AI while using other apps or even when their screen is locked. This functionality essentially turns the Gemini Live experience into a phone call, allowing users to seamlessly interact with the AI while performing other tasks on their device.
9To5Google highlighted that the AI will accept vocal inputs and provide replies as users multitask. For example, users can open Chrome on their Android phone, search for something, and relay the information back to Gemini, making the conversational experience more natural.
App Extensions
In addition to the background mode, Google is developing a feature that provides quick access to Gemini when the smartphone is locked. Users will have access to four extensions for first-party services: Google Maps, Google Flights, Google Hotels, and YouTube. These extensions will enhance the functionality of Gemini Live, allowing users to perform tasks such as asking for directions, playing music on YouTube, or booking flights.
Further details on the capabilities of these extensions are currently limited. However, users can expect default activation for four primary extensions, contingent on their access to user credentials or private data. Additionally, users can toggle three additional features for Gemini on the lock screen, including Messages for texting, Workspace for email and document management, and Home Automation for smart home device control.
Future Launch
While the exact launch date for Gemini Live remains unknown, the software was initially set to be released to Gemini Advanced subscribers in the coming months after its May announcement. The background mode and lock screen interactivity present in Gemini Live could differentiate it from competitors like Apple Intelligence, offering a more user-friendly and interactive AI experience.
Stay tuned for further updates as Google continues to develop Gemini Live and its innovative features.
