Google is bringing a new feature to the Android mobile operating system that will help people who are deaf or hard of hearing better understand non-dialog audio elements in videos and other media. The Expressive Captions tool uses artificial intelligence to caption tone, nonspeech elements, and ambient sounds like applause and cheers.
The new feature is part of Google’s existing Live Caption feature, which already enables captions on almost any media playing on your phone. Expressive Captions expands the scope by adding more detailed captions that help convey emotions and atmosphere.
Other AI-powered features being rolled out to Android include improved Gemini chatbot integrations with third-party apps like Spotify, better document scans in Google Drive, and enhanced security measures like Identity Check, which requires thieves to provide biometric authentication when trying to access sensitive settings.
Google’s Pixel phones are also getting several quality-of-life updates, including a new “Clear Voice” feature that reduces distracting noises from audio recordings. The Now Playing feature now recognizes more songs and artists on the lock screen, and Identity Check will recognize when your phone is in a new location, making it harder for thieves to access sensitive settings.
Additionally, the Pixel Watch 3’s Loss of Pulse feature is expanding to Germany and Portugal, while owners of older Pixel Watches and Fitbits can now enjoy the Daily Readiness algorithm and other tools.
Source: https://www.wired.com/story/android-pixel-december-2024-software-updates