Zuckerberg's Vision: Future of AI Interaction Through Glasses

Mark Zuckerberg envisions glasses as the future interface for human-AI interaction, despite concerns about their practicality.

### The Future of Human-AI Interaction: Mark Zuckerberg's Vision on Glasses and Open-Source AI
* 👓 Mark Zuckerberg envisions the future of human-to-AI interaction through glasses, which he believes will serve as the **ideal interface for seamless communication** with artificial intelligence.
* 💡 He emphasizes that Meta is not just a social media company but a "**social connection company**," aiming to redefine how people **connect using technology** beyond traditional platforms.
* 🔄 Reflecting on past mistakes, Zuckerberg acknowledges Meta's struggles with **platform dependency** and highlights the company's commitment to **lead in open-source AI** to mitigate such risks in the future.
* 🕶 The Meta AI Ray-Ban glasses are seen as a **step towards integrating AI into daily life**, but Zuckerberg admits that wearing glasses constantly may not be practical for everyone, raising **concerns about long-term adoption**.
* 🔍 He proposes alternative forms of interaction, such as **discreet pins or devices that can be integrated into everyday items**, which could provide AI capabilities **without the need for visible wearables**.
* 🌐 Zuckerberg also discusses Meta's strategy of **open-sourcing AI technologies** to build a community around it, effectively **neutralizing competitors like Google and OpenAI** in the process.
* 🏗 The company is focused on developing advanced AR/VR glasses, aiming to create a product that **combines functionality with aesthetic appeal**, while learning from previous experiences with mobile platforms.
* 💬 Ultimately, Zuckerberg's vision for the future hinges on creating a **natural and immersive digital social experience**, but he remains skeptical that glasses will be the **final form factor for human-AI interaction**.

In this interview, Mark Zuckerberg talks about the final form of human-to-artificial intelligence interfaces, and he also talks about open-source AI and why Meta is betting so big on it. So, let's watch the video, and I'm going to give you my thoughts. This video is brought to you by Vulture, the easiest way to deploy your generative AI applications. Go to getvulture.com/Burman and use the code Burman300 for $300 of credit right now. I'll drop links in the description below. Thanks to you guys, I got a pair of these this summer, and I genuinely love them. Tell us the story of how these came to be. You know, we at Meta, we've been building social experiences for 20 years now, and originally it took the form of a website, then mobile apps. But the thing is, I never thought about us as a social media company, right? We're not a social app company. We are a social connection company, right? I mean, we talk about what we're doing as building the future.

of human connection, and that's not only going to be constrained over time to what you can do on a phone, right? Alright, I'm going to pause really quickly. I know I didn't let him say that much, but I already know where he's going with this, and I have a lot of thoughts on it. I talked about this in previous videos, but Meta and Zuckerberg, in particular, had been burned by building all of their apps on top of other people's platforms, other companies' platforms. Originally, Facebook was on the web, but when mobile came to be with Android and iOS, Meta completely missed that wave. They tried to build their own phone internally and failed, shuttered the project, and never released it. They were exposed to severe platform risk because they were just built on other people's platforms. He's going to talk a little bit about that, and this time he's not going to make that same mistake. So, not only is he investing heavily to be the market leader in open-source artificial intelligence, but he also wants to be the interaction

layer between humans and AI, and he believes it's in the form of glasses, not phones. And I'm going to give you my thoughts on that after we watch a little bit more. When you think about, you know, we got started, okay, we're like a handful of kids, you know, we weren't able, we didn't have the resources, the time to go define whatever the next computing platform is. And also, you know, Facebook originally got started around the same time as, you know, a bunch of the early smartphones and those platforms got started, so we didn't really get to play any role in developing that platform. And one of the big themes, I think, for the next chapter of what we do is I want to be able to build what I think are sort of the ideal experiences, not just what you're allowed to build on some platform that someone else built, but like what is actually, if you can think from first principles, what is the ideal social experience. So, I think what you'd like to have is not a phone.

that you look down at um that kind of takes your attention away from the things and the people around you. You know, not just a small screen. I think would you ideally have is glasses, and through the glasses um there's one part of it where the glasses you can they can see what you see and they can hear what you hear. And in doing so, they can be kind of the perfect AI assistant for you because they have context on what you're doing. But then part of that is also that the glasses can project images, is basically like Holograms, out into the world. And that way your social experiences with other people aren't constrained to these little interactions you can have on a phone screen. You know, in the not so distant future you can imagine um because you guys have demoed some of the stuff that that that we've done a like a a version of this where we're having a conversation like this but you know maybe like one of us isn't even here. They're just like a

hologram, and we have glasses, and it really, there's the question of delivering a realistic sense of presence. There's something, so there's a lot to talk about there. Mark Zuckerberg believes the future of human-to-AI interaction is going to be in the form of glasses, and part of it makes sense, right? You're wearing these glasses, they're capturing exactly what you're looking at and what you're hearing. Those are two of the most important senses when it comes to feeding that into an AI model, and of course, he's bullish on that because he has a hit on his hands with the Meta AI Ray-Ban glasses. Most people seem to really like them, including myself. But here's the thing, they have one big flaw. You have to wear them, and you have to wear them all the time if you want to interact with AI all the time. And I don't wear prescription glasses, I wear sunglasses, and they're great outdoors. So if I'm driving or if I'm hanging out at the park, I'll put them on, and great, I could take pictures.

I could talk to my AI assistant, and that's wonderful, but I cannot imagine wearing them all day, let alone what am I supposed to do when I go indoors. Wearing glasses indoors is something that I've never done, so I'd have to get used to it. And plus, it's just something you have to wear on your face all the time, and I just don't see that becoming a thing unless you wear prescription glasses, and you kind of have to. Now, maybe they can make transition lenses where it's tinted outside and then it goes clear inside, and that would make it a little bit better. But the idea of having to wear glasses when I don't want to or don't have to just doesn't rub me the right way. And so, I think a lot of people are going to think like that. And again, I love my Meta Ray-Ban glasses, but at maximum, I wear them for 2 or 3 hours per day total. And I want to have access to my AI all the time, so I don't actually

think glasses are the final form factor of interaction between human and AI. So, a couple of other options of what I think it could be. One is AirPods or something similar to AirPods, but again, you have to wear them all the time. The ice thing is, at least in my opinion, they're much easier to wear for long periods of time than glasses are. But there's a few drawbacks. You can't project things onto the world in AR/VR, and at least currently, they don't have any way to see the world. They don't have a camera on them, but I suspect that's actually a solvable problem. But again, you are still forced to wear these things all day long, and with such a small form factor, the battery life on them probably isn't going to be great, especially when you're having to add cameras to them. So, what is that final form factor? Well, I actually think in the short and mid-run, it might actually be a pin, something that you could just wear in your clothes that you forget about throughout the day. It has a

camera. It has sensors. It has voice capabilities. It has recording capabilities. But we haven't really seen a good implementation of that yet. There's the Humane pen. There's a few other pendants that you can wear around your neck, which I think is a good solution. But all of those, the best part about them is that they kind of fade away throughout the day. You just forget that you're wearing them, and that is really important to me. But in the long run, I think the perfect form factor is none at all. I can't imagine what this actually would be, but something where you don't have to carry it around, you don't wear it, or it's something that you were already carrying around, and it's very lightweight, but basically you forget you have it. And of course, this thing has to be able to project things into the world so you can see it. It has to be able to see the world, hear the world, and all without really interrupting your day-to-day. So I don't know what exactly that device is, but if

I could write a science fiction movie. It is just there. It is just there for you. You don't actually have to have a hardware device. Maybe it's just something installed everywhere. I don't actually know. All right, let's keep watching something magical in the realm of building social experiences around the feeling of human presence and like being there with another person and this physical perception, right? Where we're very physical beings, right? People like to intellectualize everything, but a lot of our experience is very physical. This physical sense of presence that you with another person doing things in the physical world is something that you're going to be able to do through Holograms, through glasses, um, without being taken away from you, whatever else you're doing, just kind of have that mixed in with the rest of the world. Um, it's going to be, I think, the ultimate Digital social experience. So, I do agree, the ability to project things into the real world so they seem real to the human eye is incredibly important for this futuristic Vision that he has and really what I think is going to come.

true as well, but again, glasses just don't seem like the final form factor. Just last week, Snap, the company behind Snapchat, released their own AR glasses that, engineering-wise, seemed pretty darn cool, but they were extremely ugly, at least in my opinion. So, I can get behind the short-term wearing of these glasses; I just, again, don't think it's the long-term solution. I know Apple, given their Apple Vision Pro, is probably worth working towards a smaller form factor glasses solution as well, so I think that's what a lot of companies are betting on. But if I had to bet for the long run, I'm going to bet that glasses are not the final form factor. And I think it's also going to be the ultimate incarnation of AI because you're going to have conversations where it's like, All right, there's some people, it's like maybe I'm physically here, there's a person, you're like a hologram there, there's an AI that is kind of embodied as someone is there, and the

glasses will enable this. So, okay, so how are we going after this building? This is like some huge project. We've been working on it for 10 years, and there are a lot of different challenges to solve to get there. There's like, you have to build a novel display stack, right? It's not, these aren't just screens like the kind that are in phones. There's this long lineage, they're connected to the screens that have been in TVs and monitors and things for a long time. There's been this massive optimization of the supply chain. There's like brand new display stacker on holographic displays that basically need to get created, and then they need to be put into glasses. They need to be miniaturized, and you also in the glasses need to fit chips, microphones, you know, speakers, cameras, eye tracking to be able to understand what you're doing, batteries to make it last all day, new novel RF protocols. Yeah, it's like, okay, it's a pretty big challenge. So, we're like, all right, let's go try to go.

for the big thing right, and we've been working on that for a while, and we're pretty, pretty close to being able to show off kind of the first prototype that we have of that, and I'm really excited about that. At the same time, we also came at it from this L. All right, so just a little news there. He said they're really close to releasing this AR/VR glasses thing that has meta built into it, and now he's going to continue the story but talk about how the meta AI glasses came to be because they weren't always meta AI glasses. They were just simply a collaboration between meta and Ray-Ban to take pictures and to basically post things to Facebook and to Instagram and to WhatsApp. It was not at first meant to be AI glasses, and this is why Mark Zuckerberg is just so good because he has these ideas, and he pushes his team to do it in such a short period of time. Let's listen. So, that's like a lot of new technology that needs to get developed, a lot to pack into a form.

factor 'cause the glass has to be good-looking too. So what if we just ourselves to like we're going to work with a great partner, Esor Luoda. They make Ray-Ban, they make a lot of the iconic glasses. Let's see what we can fit into glasses today and make them as useful as possible. And you know, I actually, I kind of thought when we were getting started with those that it was almost like a practice project for like for the ultimate, which let's be clear, that's what you thought Facebook was. That's true, that's true. Yeah, I did like for your real startup, Somay. That's true, yeah. No, this is, let's go on a tangent there for a second. When so started Facebook in school, came out to Silicon Valley with Dustin and a handful of people working on it at the time. And we did that because Silicon Valley's where all the startups came from. And I remember we got off the plane, we were driving down 101, we're like, Wow.

eBay, Yahoo, like this is amazing. All these great companies, one day we're maybe, we'll build a company like this. And I'd already started Facebook, and I was like, surely the project that we're working on now is not a company. And Facebook had like some scale at this point. Oh no, no, it was a great project. I just didn't have the ambition to turn it into a company at the time. That just kind of happened. Um, but anyway, um, uh, yeah, I mean a lot of hard work obviously, but it's, but I, I just at the time I was kind of like, yeah, no, I, I don't, I don't think this is it. Um, well, that's your answer of would you have started. You actually didn't try to start Facebook. I didn't know. So yeah, so I mean the glasses though, you know, we thought that this was like, all right, we want to get working with esor luoda so we can start building more and more advanced glasses. And then, you know, they're really good, they look good and

then AI like the massive transformation in AI for listeners. Let's just be really clear, you guys shipped this product that I'm holding before llms, or at least before the public consciousness was aware of, you know, the chat PT moment. And these were not manufactured and shipped as an AI device. That came later when they were already in market. Yeah, a few years ago I would have predicted that AR holograms would have been available before kind of like full-scale AI. And now I think it's probably going to be the other order. So what he's saying, and very similar to the Apple Vision Pro, these are heavy goggles that you put on and you just don't wear them all day. And then meta kind of came in from the bottom as well. They just had very simple glasses, no AR, no VR, just enough to take a picture. And I believe Apple has abandoned, at least for the time being, their work on Apple Vision Pro and instead are entering the market from the bottom as well. They are creating very basic glasses and will add

to their functionality over time, and I really like that approach. So, you're basically going in from the top and from the bottom, and you're kind of seeing what's going to work, and then both companies are going to end up in the middle where they have these incredibly lightweight, incredibly functional, and a lot of AI built into it, but they're not goggles, and they're not just basic glasses. They're somewhere in the middle. So now, it's like, All right, great. Well, this is actually a great product because it's got the cameras so it can see what you see, it's got the microphone, it's got the speakers. You can, and actually, let me say one more thing. One of the most genius moves that Mark Zuckerberg did here was work with Esor Luxotica, the company behind Ray-Ban and a million other glasses brands. Basically, they own the entire market. That's a whole other subject in itself. They are a complete monopoly in the glasses market, and he worked with them because they already had gorgeous glasses, so he

thought, okay, how much can we fit into these existing beautiful glasses, and then we'll go from there. I remember calling Alex Himel, the guy who runs the product group that's running it, and I'm like, Hey, you know, I think we should probably pivot this and make it that meta AI is the primary feature of it. And then, like, I remember I came in the next week, and they built a prototype of it on Tuesday, and it was like, All right, good. Yeah, no, this is good. This is going to be a very successful product. One week, they had the glasses. The glasses had chips in them. They had cameras. They had microphones. They had speakers. One week, he just made a phone call and said, Hey, I think this should be an AI product. And then within one week, they had a demo of it, which is just insane to think about. And that is why being a founder-led company is also so important, because founders can make those types of decisions and pivot an entire product line on a dime. And he

was right. I mean, I'm going to say it again: I love my glasses. So, let's keep watching. Told us a much more high-stakes version of that story. He, like, so I was on the highway with my kids, and I get this call on a Saturday from Mark, and he's like, Those glasses, could we put meta AI in them, running on device, and like ship that soon so we can see if that's a good idea or not? Yeah, that's that tracks, that's what I just said, sounds right. Next, Mark is going to talk about open-source AI and why meta went all in on open source and what that means to meta as a company and the ecosystem more broadly. We've also had an interesting relationship with this because sequentially as a company, we came after Google. So, Google was the first of the great companies that built this distributed computing infrastructure. So, they came first, so they were like, All right, let's keep this proprietary because it's a big advantage for us, and then we're like, All right, we need that.

too, but we built it, and then we're like, okay, not an advantage for us because Google already has that, so uh, we might as well just make it open, and by making it open, then you basically get this whole community of people building around it. So, you know, it wasn't going to help us compete with Google for any of the stuff that we were doing to have that technology. So, what he just said is actually less important than what he didn't just say. What he really meant to say is, we open-sourced it, and then we took away Google's advantage, not that we weren't going to compete with them. So, we open-sourced it, and so we built a community around it. No, no, no, the reason they open-sourced it is so that they could take away Google's advantage in distributed computing. And next, what he's going to explain is how he did the exact same thing to OpenAI, and it is such a ruthless strategy. I love it. I'm a hyper-competitive person, and I just love to hear these types of stories.

this is also known as the scorched Earth strategy. So let's keep watching, but what we were able to do with things like open compute were, um, get it to become the industry standard. So now you have like all these other, you know, cloud service platforms that, you know, basically use open compute. And because of that, the supply chain is standardized around our designs, which means that it's like way more supply, way cheaper to produce. We've saved billions of dollars, and the quality of the stuff that we get to use goes up. So all right, that's like a win-win. But I think in order for this to work, we do a lot of open-source stuff, we do a lot of closed-source stuff. I'm not like a zealot on this. Um, I think open source is very valuable, but I also think it sort of makes sense for us because of our position in the market, and the same for AI. I mean around L, okay, this is where we were going with this. Yeah, it's um, you know, similar deal. Um

you know we want to make sure that we have access to a leading AI model, right? I think just like we want to build the hardware so that we can build the best social experiences for the next 20 years. I don't think that, you know, for us, it's like we've just been through too much stuff with the other platforms to fully depend on anyone else. And we're a big enough company at this point that, like, we don't have to, right? We can build our own core technology platforms, whether that's going to be AR glasses or mixed reality or AI. So I think that's somewhat of an imperative for us to go do that. But, you know, these things are not like pieces of software that are monolithic; they're ecosystems. They get better when other people use them. So for us, there's a huge amount of good, and it philosophically lines up with where we are. We're like, I mean, look, I definitely, you know, firsthand have a lot

of experiences. We were like trying to build stuff on mobile platforms. The platforms are just like nah, you can't build that. Okay, uh, that's frustrating. So, that is the exact lesson that he learned on iOS and Android, but mostly iOS because of Apple. Apple just decided one day that Facebook shouldn't be able to track users across apps, or at least users should have the option to turn that off. And it really hurt Meta's bottom line for a short period of time. They recovered definitely, but it was just a single decision that Apple made. And again, Meta just had complete platform risk, and he will avoid that at all costs. And the cost seems to be hundreds of billions of dollars because they're building their own AI and open sourcing it. They're building their own glasses. They're building their own AR/VR goggles. So, he learned his lesson, and now all of us benefit. So, there it is. Zuck believes the future of AI to human interaction is glasses. What do you think? Do you think glasses are the future of AI interactions? I personally do not. If

you enjoyed this video, please consider giving a like and subscribe, and I'll see you in the next one.

Zuck Reveals AI's "Final Form", Open-Source, and Scorched Earth Strategy

Artificial Intelligence (AI), Open Source, Generative Art, AI Art, Futurism, ChatGPT, Large Language Models (LLM), Machine Learning, Technology, Coding, Tutorials, AI News, and more

** Exclusive Pinecone Partner **

Matthew Berman

Mark Zuckerberg on Human-AI Interfaces and Open-Source AI

Mark Zuckerberg discusses Meta's vision for the future of human-AI interaction, emphasizing the importance of open-source AI and learning from past platform dependencies.

He believes that glasses, rather than phones, will be the ideal interface for connecting humans and AI, offering context and projecting holograms for seamless social interactions.

Zuckerberg aims to build the ideal social experiences from first principles, moving away from traditional screen-based interactions.

The Future of Human-AI Interaction: Beyond Glasses

Mark Zuckerberg envisions AI interaction through glasses, capturing users' sight and sound, but the need to wear them constantly is a major flaw.

Alternatives like AirPods offer easier wear but lack AR/VR projection and have battery life limitations.

The author suggests that a pin or pendant with camera and voice capabilities could be a better short-term solution, while the long-term ideal form factor would be a lightweight, unobtrusive device that seamlessly integrates into daily life.

The vision for the future includes using holograms and AR glasses to create a physical sense of presence with others, blending digital interactions with the real world.

While companies like Snap and Apple are working on AR glasses, the speaker believes they are not the final form factor for this technology.

The speaker's project aims to develop a novel display stack and miniaturize it for glasses, while also incorporating AI and other technologies to create a seamless digital social experience.

The Evolution of Glasses and AI Integration

The speaker discusses partnering with Esor Luoda, known for making iconic glasses like Ray-Ban, to create functional and stylish eyewear.

The conversation shifts to the speaker's journey with Facebook, highlighting the unexpected transition from a project to a successful company.

The speaker emphasizes the simultaneous efforts of Meta and Apple in the glasses market, aiming to create lightweight, functional eyewear with integrated AI, while Esor Luxotica's dominance in the glasses market plays a crucial role in the collaboration.

Meta's AI-Powered Glasses and Open-Source Strategy

Meta's product group quickly pivoted to make AI the primary feature of their glasses, resulting in a prototype within a week.

The company's founder-led approach allowed for swift decision-making and product development.

Meta's open-source strategy aimed to disrupt Google's advantage in distributed computing and has since standardized the industry, resulting in cost savings and improved quality.

Building a Leading AI Model and Core Technology

The company aims to build its own core technology platforms, including AI and AR glasses, to avoid dependency on other platforms.

The founder's past experiences with mobile platforms, particularly Apple's decision to limit user tracking, highlighted the risks of platform dependency.

The company's strategy to mitigate these risks involves investing billions in building and open-sourcing its own AI, as well as developing AR/VR goggles.