Google Revamps Project Astra with AI-Powered Smart Glasses
A New Era of Mixed-Reality Technology
Google Glass may not have been the success that the tech giant had hoped for, but it seems that the company is still convinced that we’re heading towards a future where we’ll want wearable mixed-reality technology. Advances from Meta and Apple have only encouraged Google to push forward, and now the company is putting two of its favorite techs together: smart glasses and AI.
Project Astra: The Future of AI-Powered Glasses
We first got a glimpse of Google’s Project Astra, an always-on AI agent, back in May. Now, the company has shared a new demo of its prototype for a multimodal virtual assistant that would live in your phone – and your glasses – and would be able to see everything you do.
A Small Group of Testers to Begin Testing Project Astra Prototype
At the briefing for the launch of Gemini 2.0, Google revealed that a small group is to begin testing Project Astra prototype Gemini AI glasses as part of its Trusted Tester programme. A group of testers will also test Project Astra on Android phones.
What’s New with Project Astra?
The idea is that having an AI agent in glasses form will help with things like providing directions and language translations in situations where we want to have our hands free. Compared to where things were in May, Google says Astra can now understand more languages, mix languages and understand accents and "uncommon words". It can also understand language at about the latency of human conversation with new native audio understanding and streaming capabilities.
Astra Can Now Access Google Maps, Lens, and Search
Astra can now access Google Maps, Lens, and Search to answer questions, and it now has 10 minutes of in-session memory and can remember previous conversations.
Android XR: A New Operating System for Smart Glasses and Headsets
Meanwhile, Google has announced the launch of a new operating system, Android XR, for both smart glasses and headsets. Available as a preview for developers for now, it supports tools like ARCore, Android Studio, Jetpack Compose, Unity, and OpenXR to allow developers to start building apps and games for upcoming devices.
A New Era for Mixed-Reality Technology
Known as Project Moohan internally, the operating system signals Google’s intention to take on rivals Apple and Meta in the AR and mixed-reality space. Apple’s expensive Vision Pro was hardly destined for mainstream success, but it introduced the concept of spatial computing, which Google appears to have taken pointers from.
Conclusion
Google’s prototype looks much more powerful thanks to its integration of Gemini with various apps and its ability to remember. However, we don’t know what form it will take if it ever reaches the market. We’re told that Android XR is a collaboration with Samsung and Qualcomm, and we’ve also seen a glimpse of what looks to be a Samsung mixed-reality headset. This could mean that it will be Samsung rather than Google itself that launches the first Gemini AI glasses. That makes me wonder if they would be as appealing to the fashion-conscious consumer as the Meta-RayBan offering.
FAQs
Q: What is Google’s new project?
A: Google’s new project is called Project Astra, an always-on AI agent that will live in your phone and glasses.
Q: What is Android XR?
A: Android XR is a new operating system for smart glasses and headsets.
Q: What is the purpose of Project Astra?
A: The purpose of Project Astra is to provide a multimodal virtual assistant that can live in your phone and glasses and provide directions, language translations, and other services.
Q: When will Project Astra be available?
A: No release date has been announced, but a small group of testers will begin testing the prototype soon.
