Gemini AI on Android XR for Glasses & Headsets
Source: blog.google
AI and XR are converging, enhancing glasses with Android XR for simpler AI use and novel experiences. We previously detailed Gemini and Android's synergy across phones, watches, TVs, and car displays. Now, we're exploring further applications.
Imagine an AI assistant sharing your perspective and providing hands-free assistance. This concept drives our advancements in Android XR, the first Android platform designed for the Gemini era, supporting headsets and glasses. Gemini on these devices offers an assistant that shares your viewpoint and aids conversations, freeing your hands to engage with the real or virtual world.
Android XR was introduced with Samsung and Qualcomm, showcasing immersive experiences on headsets like Samsung’s Project Moohan. Gemini enhances Android XR headsets by understanding visuals and acting accordingly. You can inquire about your view using Gemini on Android XR headsets.
We previewed glasses with Android XR, a concept we've developed for over a decade. These glasses, equipped with cameras, microphones, and speakers, connect to your phone for app access without needing to reach into your pocket. An optional in-lens display offers private, helpful information. Gemini integration allows the glasses to understand your context, remember important details, and assist you throughout the day.
A demonstration showcased Android XR glasses in real-world scenarios, including messaging, appointments, directions, and photos. Live language translation was also demonstrated, providing real-time subtitles to break down language barriers.
Get real-time translations to assist you in unfamiliar locations.
Receive information and send messages while mobile.
Locate nearby points of interest and receive directions.
Capture moments without needing your phone.
We're collaborating with brands and partners to realize this technology. We recognize the importance of all-day wearability for glasses. We've partnered with eyewear brands like Gentle Monster and Warby Parker to create stylish Android XR glasses. We anticipate future collaborations with partners like Kering Eyewear for more options. We're also extending our partnership with Samsung beyond headsets to include Android XR glasses. Together, we're developing a software and hardware platform for creating exceptional glasses. Developers can begin building for this platform later this year.
To ensure user privacy and product assistance, we're gathering prototype feedback from trusted testers. Further updates on our progress and device availability will be shared in the coming months via our newsletter.