Google has announced Android XR. Samsung has a mixed-reality headset for Google, and there are glasses in the works, too. This is a lot to digest, and I just got out of a demo of this stuff. Let me talk to you about it. Google's been promising a

collaboration with Samsung and Qualcomm for a year now, talking about this future of mixed reality. We already have Apple in the landscape; we already have Meta in the landscape; and we also have other fringe players as well. Now Google is back in the landscape; they had been

out of VR and AR for the most part, and they're back in. Android XR is a new platform, and it's going to work with phones and it's going to work with other things, and it's Gemini-powered—in that Gemini AI is going to run throughout it

to work, not only on mixed-reality headsets, but Google says it'll be on AI glasses, AR glasses, and all sorts of other emerging wearables for your face. Now, what I got to try—because right now it's only for developers—is a headset made by Samsung that's a mixed-reality

headset and also a pair of notification glasses that Google calls Project Iris. These have been in the works for a little while, and they're going to start being field-tested soon. Now, bear with me because I'm going to be talking a lot, and we don't have any photos or video of

my demo because they were not allowed. That's pretty standard issue for early VR and AR in my experience. So, first of all, Project Muhan—which is the name of the mixed-reality headset for now that Samsung is going to release next year—looks a lot like a Vision Pro, or it

Looks like the Meta Quest Pro—if you remember that headset, it's a visor-type headset that fits on your head. It's got lenses that can block out light if you want. It tightens in the back; it has a nice, crisp display. It has hand

tracking and eye tracking. That's not what's exciting, though; a lot of that feels very familiar. But when I tried demos in this headset, bringing up 2D apps in a very Android-like interface, I was able to bring up familiar Google apps and navigate using my hands and

bring up different panes. But I could also turn on Gemini to be my companion throughout the whole journey. Now, you already have things like Siri working on Apple Vision Pro, and there are some voice AI things in the Meta Quest, but this is something that can also see what

you're doing. And why that gets fascinating is I could actually point to something and say, "Hey, what is that?" or "Tell me more about this," and move my hand there, and Gemini will tell me what I found. I was able to browse the web,

I was able to ask it a question about something or ask about where I live; it pulled up a map. Google also has immersive apps for this at the moment; YouTube and Maps were the most notable. Apple doesn't even have a Vision Pro immersive Maps app yet. Maps allowed me

to throw this big 3D immersive environment up, zoom into my home, but also I was able to point out things in the landscape and ask about them, and Gemini could tell me what those were. And that combination got really interesting. I felt like I was starting to get lost

In the apps and navigating around, Gemini can not only recognize what you're doing, but it can also remember. When I got done with a whole bunch of demos, I asked Gemini to recap what I'd been doing, and it told me all the different things I'd been doing. And it has tricks I haven't seen before; like, I played a YouTube video, and Gemini improvised captions for the YouTube video.

Google has a few other tricks up its sleeve with Android XR. One of them is auto-converting 2D photos to 3D, which is something that Apple also does now with Vision Pro, but they also do it for videos. I looked at a video clip on the headset that was already converted—uh, Google said—but also I watched a YouTube clip that had been converted. I didn't get to see the live conversion process, but it was pretty

wild to see that that capability is going to be there. So that's all the mixed reality stuff, which is going to be on this developer headset that is meant for people to start getting a feel for it and build kind of a starting point for everything else. But then there are

the glasses. I put on these glasses that look like—uh, Meta Ray-Ban—kind of chunky, but pretty normal and wireless. And there was one display on these glasses, a little area here etched in with waveguides and a micro-LED display projector over here that was able to

give me a heads-up display. What I was able to do with that: a whole bunch of stuff! I could activate Gemini with a button here and turn it into kind of an always-on Gemini mode, identify works of art on the wall in a fixed living room.

I set identifying questions about objects. I had questions about books; I was able to again indicate certain things and have it tell me about them.  And translation: you could translate things and then also ask for the language back. What I found fascinating was that it could also do live, interactive

translations. So, somebody in the room came up and spoke Spanish to me; it instantly brought up not just the captions for what they were saying to me in English, but they also brought up—still in English—when they started speaking in Spanish. All of this stuff

assumes that you're going to have an always-on Gemini assistant in your life. Now, with conversational responses, that could feel very intrusive, but on the glasses you were able to pause it by simply tapping on the side and basically suspending it. But it was very different

than something like Meta Ray-Bans, which assume you won't be using it until you ask for it. Here, it was like it would assume you have it on until you want to pause it. And the same thing goes for VR and mixed reality: am I going to turn on

Gemini and then suddenly have this running all the time? That could really impact the experience of how I use apps. It's fascinating for things like, let's say I'm playing a game and I want to know a tutorial, or I have questions about

something. It kind of breaks the fourth wall of VR and AR, and it may change the way that apps are developed. But let's back up a step: this is all for developers right now, and Android XR is going to be unveiled in a fuller state next year, according to Google.

Samsung is going to announce and go into more detail on its potentially very expensive mixed reality headset.  It's expected to be kind of like a Vision Pro, and a lot of people may not want to buy it, but it will be there.  The other thing

that's really interesting is where all the glasses go, and that could be the year after, starting with these assistive types of glasses. There are already other partners in the works, like XREAL; we just saw some glasses made by them. Google's going to have a lot of different

partners making AI and AR glasses that work now that they're going to be working with phones. Well, the ball is going to be in Apple's court: when does Apple introduce generative AI to the Vision Pro, and when will Apple start allowing connections to the iPhone for

Vision Pro products? Because right now that doesn't happen, but I think it's really key for what comes next. It looks like it's going to make the idea of everyday glasses feel a lot more instantaneous, but we don't really know about battery life yet, so that is one

wild card here that could be pretty significant. That's a lot to digest, and I'm still digesting it myself. You have questions, which I'm sure you do; leave them below, and I'll be following up with more as we learn more about this. But I was just glad to get

the demo, and I'm asking a lot more questions about what AI is going to be in VR and AR than I ever had before. Thanks for watching.

I Tried Google and Samsung's Android XR Headset and Glasses: Gemini AI Can See My Life Now

CNET is the premier destination for explaining and navigating the changing world around us. Through news, product reviews, price comparisons, and more, we’ll tell you what’s new in the parts of modern life that increasingly matter more — from health, home, and money to tech, culture, and climate — and how to get the most out of them.

CNET

Android XR과 Google의 혼합 현실 시장 재진출을 발표합니다.

Google에서 Gemini AI 기반의 혼합 현실 헤드셋과 안경을 위한 새로운 플랫폼인 Android XR을 발표합니다.

구글은 삼성 및 퀄컴과의 협업을 통해 혼합 현실 환경에서 강력한 입지를 구축하여 Apple 및 Meta와 경쟁하는 것을 목표로 하고 있습니다.

Android XR은 휴대폰 및 기타 기기에서 작동하며, 기능을 위해 Gemini AI를 활용합니다.

현재 삼성에서 만든 혼합 현실 헤드셋과 구글의 프로젝트 아이리스 안경이 개발자 테스트용으로 제공되고 있습니다.

삼성 혼합 현실 헤드셋(프로젝트 무한)의 특징 및 기능.

헤드셋의 디자인은 바이저형 디자인, 렌즈, 손 및 시선 추적 기능을 갖춘 Apple Vision Pro 및 Meta Quest Pro와 유사합니다.

이 헤드셋을 사용하면 핸드 내비게이션으로 익숙한 Google 앱에 액세스할 수 있으며 대화형 지원을 위해 Gemini AI를 통합할 수 있습니다.

Gemini AI는 사용자가 가리키고 질문하고, 정보를 제공하고, 작업을 수행하여 환경과 상호 작용할 수 있게 해줍니다.

YouTube 및 지도와 같은 몰입형 앱은 Gemini가 제공하는 향상된 3D 경험과 대화형 기능을 제공합니다.

Gemini AI는 사용자 활동을 요약하고, YouTube 동영상에 캡션을 생성하고, 2D 사진과 동영상을 3D로 변환할 수 있습니다.

Google 프로젝트 아이리스 안경의 특징 및 기능.

프로젝트 아이리스 안경은 마이크로 LED 디스플레이 프로젝터와 도파관 기술이 적용된 헤드업 디스플레이를 제공합니다.

Gemini AI 통합은 상시 지원, 객체 식별 및 번역 기능을 제공합니다.

이 안경은 실시간 대화형 번역을 제공하여 사용자가 선택한 언어로 캡션을 표시합니다.

항상 켜져 있는 Gemini 어시스턴트는 안경 측면을 탭하여 일시 중지할 수 있으며, 사용자가 기능을 제어할 수 있습니다.

Android XR의 향후 전망과 시사점.

Android XR은 내년에 삼성의 혼합 현실 헤드셋과 함께 완전히 공개될 예정입니다.

구글은 다양한 파트너와 함께 AI 및 AR 글래스를 출시하여 시장에서의 입지를 넓혀나갈 계획입니다.

비전 프로에 대한 제너레이티브 AI와 iPhone 연결의 통합은 향후 개발에 있어 매우 중요합니다.

배터리 수명은 AR 글래스의 광범위한 채택을 위해 여전히 고려해야 할 중요한 요소입니다.