Gemini AI on Android XR for glasses & headsets
Source: blog.google
AI and XR are coming together, creating new experiences with glasses running Android XR that make AI even easier to use. We’ve explored how Gemini and Android can work together across devices. Now, we're considering how it can help you next.
The latest advancements in Android XR are driven by the idea of an AI assistant that understands your perspective and offers hands-free assistance. This is the first Android platform built in the Gemini era, designed for headsets, glasses, and more. Gemini on these devices provides an assistant that shares your viewpoint and is ready to assist. This allows you to stay present and engaged.
Android XR headsets, such as Samsung’s Project Moohan, will offer immersive experiences. Gemini enhances Android XR headsets by understanding your view and acting on your behalf. You can ask questions about what you're seeing with Gemini on Android XR headsets.
We presented glasses with Android XR. These glasses, equipped with a camera, microphones, and speakers, work with your phone to provide access to apps without needing to reach for it. An optional in-lens display offers helpful information when needed. Pairing these glasses with Gemini allows them to understand your context, remember important details, and assist you throughout the day.
A preview demonstrated how Android XR glasses can be used in real-world scenarios like messaging, making appointments, getting directions, and taking photos. Live language translation between people was also demonstrated, showcasing the potential to break down language barriers with real-time subtitles. You can see translations in real time, get information, send messages, find points of interest, get directions, and capture moments without your phone.
We're collaborating with brands and partners to bring this technology to life. We’re partnering with eyewear brands, including Gentle Monster and Warby Parker, to create glasses with Android XR. We anticipate working with more partners, such as Kering Eyewear, and are advancing our partnership with Samsung to expand Android XR to glasses.
Together, we’re creating a software and reference hardware platform to enable the creation of great glasses. Developers will be able to start building for this platform later this year. We are gathering feedback on prototypes with testers to ensure privacy and assistance. More details on progress will be shared, and updates on device availability will be available through our newsletter.