Google Unveils New AI Features for Gemini Live
AI-Powered Screen Reading and Live Video Capabilities
Google has started rolling out new AI features to Gemini Live, allowing it to "see" users’ screens or through their smartphone cameras and answer questions in real-time, according to a Google spokesperson.
Screen-Reading Ability
The feature, which was first demonstrated by Google under the codename "Project Astra," uses AI to read the content on a user’s screen and answer questions about it. A Reddit user recently spotted the feature on their Xiaomi phone and shared a video demonstrating its capabilities.
Live Video Capabilities
The other Astra capability being rolled out is live video, which uses AI to interpret the feed from a user’s smartphone camera in real-time and answer questions about it. In a demonstration video published by Google, a person uses the feature to ask Gemini for help deciding on a paint color for their freshly-glazed pottery.
Release Timeline
The features are expected to start rolling out to Gemini Advanced Subscribers as part of the Google One AI Premium plan later in the month, Google announced in early March.
Conclusion
These new AI features mark a significant advancement in the capabilities of Google’s Gemini Live platform, enabling users to access information and assistance more easily and efficiently. With the ability to read screens and interpret live video feeds, Gemini is poised to become an even more powerful tool for users seeking information and assistance.
Frequently Asked Questions
Q: What is Project Astra?
A: Project Astra is a Google initiative that aims to develop AI-powered features for its Gemini Live platform.
Q: What are the new AI features being rolled out?
A: The new features include screen-reading ability and live video capabilities, which allow Gemini to "see" users’ screens or through their smartphone cameras and answer questions in real-time.
Q: When will the features be available?
A: The features are expected to start rolling out to Gemini Advanced Subscribers as part of the Google One AI Premium plan later in the month.
