Google is rolling out several features to its AI assistant, Gemini Live. The updated chatbot will enable users to receive real-time visual guidance on their screen, making it easier for the AI to point out specific items while sharing camera feed. Additionally, Gemini Live will soon be able to interact with phone apps, such as Messages and Phone, allowing users to draft texts or messages with ease.
The new feature will debut on newly announced Pixel 10 devices launching on August 28th, followed by visual guidance on other Android devices before expanding to iOS “in the coming weeks.” Furthermore, Google is launching integrations that enable Gemini Live to interact with more apps, including Clock and Messages, allowing users to send messages or interrupt conversations.
Gemini Live’s audio model has also been updated to improve its use of human speech elements like intonation, rhythm, and pitch. Users will soon be able to adjust the chatbot’s tone based on the topic being discussed, speed up or slow down the conversation, and even adopt an accent for a more engaging narrative.
These enhancements aim to enhance user experience and provide more interactive and personalized conversations with Gemini Live.
Source: https://www.theverge.com/news/763114/google-gemini-live-ai-visual-guidance-speech-update