Google’s Gemini Live has been released as a free feature on all Android devices with the Gemini app, allowing users to recognize everyday items, artwork, and more using its camera and screen sharing capabilities. The feature uses generative AI capabilities to identify objects and provide information about them.
Gemini Live is part of Google’s Project Astra, an experimental next step for generative AI capabilities beyond simply typing or speaking prompts into a chatbot. The feature has been rolled out initially on Pixel 9 and Galaxy S25 phones, but will soon be available for all Android users.
In tests, Gemini Live showed impressive accuracy with household items, but sometimes struggled with more obscure objects. It was able to identify specific gaming collectibles and artwork, including kanji characters. However, the feature can be frustrating at times, with instances of misidentification and incorrect answers.
To use Gemini Live, simply enable the camera and start talking. The feature has already been demonstrated in a YouTube video showcasing its capabilities. With its potential to change how we interact with the world around us, Gemini Live could revolutionize the way we recognize objects and access information about them.
Source: https://www.cnet.com/tech/services-and-software/gemini-lives-new-camera-trick-works-like-magic-when-it-wants-to