Google has upgraded its smart home experience with the integration of Gemini, its set of artificial intelligence large language models (LLMs). This new feature enables AI-generated summaries, automations, and a search function for Google Nest security cameras.
Nest cameras can already detect general motion, people, and animals. However, with the introduction of Gemini-powered search, users will receive more detailed descriptions of captured information. For example, when a camera captures footage of children jumping into a swimming pool, it will provide a description like “Three children jumping into a swimming pool, chasing after a pool toy.”
This feature reduces false alerts and provides valuable insights into the camera’s content. Users can also search for specific clips by asking questions like “When did the kids go into the pool?” The AI assistant will reference the relevant footage to answer the query.
For Nest Aware Plus subscribers who opt-in to AI camera search, detailed descriptions of clips will be displayed in the Google Home app. They can also create automations based on what’s detected in the image. For instance, a user can ask Google Assistant if their kids left their bikes on the driveway and set an automation to remind them to bring their bikes into the garage when they arrive from school.
These features will become even more useful when combined with Nest Aware’s people identification feature. Users will be able to receive custom greetings or messages through the video doorbell, and ask questions like “When did X person bring in the groceries?”
Google has also announced an updated Google Assistant that will better understand and respond to user queries. The new technology will handle follow-up questions, maintaining conversational context for more natural and fluid interactions.
Source: https://www.zdnet.com/article/googles-smart-home-gets-ai-camera-search-but-only-for-these-nest-cameras