구글의 제미니 2.0: AI 발전 및 프로젝트 발표

### Google의 주요 AI 발표 제미니 2.0, 프로젝트 아스트라 등
* 🚀 Gemini 2.0이 공식 출시되어 놀랍도록 빠르고 저렴할 뿐만 아니라 **이전 버전인 Gemini 1.5 Pro보다 2배 더 빠른 최신 프론티어 모델인 Gemini 2.0 Flash**를 통해 AI 경쟁에 대한 Google의 의지를 보여주었습니다.
* 📊 새 모델은 **이미지, 비디오, 오디오를 포함한 멀티모달 입력 및 출력을 지원**하며 **Google 검색과 같은 기본 도구 호출 기능**을 갖추고 있어 경쟁사들과 차별화됩니다.
* 💻 Gemini 2.0 Flash는 자연어로부터 코드를 생성하는 데 **93%에 가까운 성공률**을 기록하는 등 인상적인 벤치마크를 달성했으며, 현재 개발자와 Gemini 앱을 통해 사용할 수 있습니다.
* 🧠 AI가 카메라를 사용하여 세상과 상호작용할 수 있는 **프로젝트 아스트라**도 공개되어 현재 안드로이드 전용이지만 **향상된 메모리와 추론 기능**으로 더욱 발전된 AI 어시스턴트 경험을 제공합니다.
* 🌐 Emergence AI는 복잡한 웹 작업을 자동화할 수 있는 **엔터프라이즈급 멀티 에이전트 오케스트레이터**를 도입하여 개인 정보 보호와 보안을 강조하는 동시에 기업이 프로세스를 효율적으로 간소화할 수 있도록 지원합니다.
* 📈 Google은 상담원이 웹 브라우저를 제어할 수 있는 Chrome 확장 프로그램인 **프로젝트 마리너를 실험**하여 자율적으로 작업을 완료하는 데 **83.5%라는 놀라운 성공률**을 달성했습니다.
* 🎮 놀랍게도 구글 딥마인드는 **제미니 2.0을 활용하여 비디오 게임에서 플레이어를 지원할 수 있는 에이전트**를 개발하여 다양한 애플리케이션에서 AI의 다재다능함을 선보이고 있습니다.
* 🔬 마지막으로, 구글은 큐비트가 증가함에 따라 오류율을 감소시키는 **Willow 양자 칩**을 발표하여 암호화 및 복잡한 계산에 잠재적인 영향을 미칠 수 있는 양자 컴퓨팅의 중요한 발전을 이루었습니다.

Google의 Gemini 2.0 Flash는 이전 버전을 능가하는 멀티모달 기능과 기본 도구 통합 기능을 제공합니다.

All right, Google just made a bunch of Gemini announcements. Gemini 2.0 is here; we have Project Astra, we have agents that can browse the web, we have deep research, and so much more, plus a bunch of other news stories that happened this week. Let's get into it. All right now,

right, so first, the biggest news story of the week: Gemini 2.0 is here, and Google is making a big push to let it be known they are in the AI race very much so. Let's go over some of the announcements because there were a lot. The first thing

is Gemini 2.0, their newest Frontier Model, and they have a Flash version, which is incredibly fast, very cheap, but still performs really well. Gemini 2.0 Flash outperforms Gemini 1.5 Pro. Yes, you heard that right: the 2.0 Flash model,

the small model, the fast model, outperforms the previous Pro version of 1.5, and it's twice as fast. It supports multimodal inputs like images, video, and audio. 2.0 Flash also supports multimodal output like natively generated images mixed

with text and steerable text-to-speech, multilingual audio. It can natively call tools like Google Search. This is a critical differentiator because not many people have that native search feature; they're using either the Brave browser or some other third-party search versus having the index themselves, and this is

really where Google can shine. And it has code execution, which, of course, ChatGPT just announced, and other tool calling. So how does it perform? Well, here are all the benchmarks on the left side. Here's Gemini 1.5 Flash and Gemini 1.5 Pro, both

of which pretty much across the board. Gemini 2.0 flash, experimental, beat. And if you've been keeping an eye on the top leaderboards, you know that the Gemini models have been in the top three for weeks, if not months now. Now this is the

one that's really impressive: nearly 93% on natural-to-code. That is, being able to generate code from natural language. And they have live code bench right here at 35%. Now, one thing that model providers sometimes do that I don't really like is just compare their models

versus other versions of their models. Now, I want to see it compared to Llama, ChatGPT, Claude, and so on. I don't want to just see one family of models compared to itself. So, just a little piece of feedback to Google, if you

happen to be watching this. Gemini 2.0 flash is available right now, so try it out. And not only is it available now to developers, but it's also available in their Gemini app, which is their AI assistant. And I have an iPhone, so I'm

not really using it, but I bet it's better than Apple intelligence. But that's not all. Gemini 2.0 flash is especially good at native user interface interaction; basically, it can browse the web on your behalf. And that is a big theme of all the announcements; they are

very much seeing the future as agentive, which, of course, I know I sound like a broken record, but bullish on agents. So all of the features announced with Gemini 2.0 help it to be able to navigate complex UI environments; so, multimodal reasoning, long context

Understanding complex instruction following, planning, compositional function calling, native tool use, and improved latency—they all work together for a new class of agentic experience. Next is Project Astra, and we saw a preview of this a long time ago, but now it seems like it's

finally here. So, if you're not familiar with Project Astra, it is a way for AI to basically use your camera, look around at the world, and be able to tell you things about the world. So you can ask it questions, and it can see, and it

seems really cool. And it's much more than just a vision-capable model; it can remember things and it can reason about your environment based on that memory. There are a lot of potential use cases that can be unlocked; it's essentially like having a second brain. Fellow AI

YouTuber Matt Wolfe was actually invited to London by Google to try it out, and he just posted a video, so definitely check that out. So you can kind of think of it like advanced voice mode, but with vision, memory, better reasoning, and basically all the things. So it seems

really impressive. Now, the only problem—I think it's only available on Android. So, some of the improvements: better dialogue, new tool use, better memory, improved latency. So these are all very welcome features of an AI assistant that's really supposed to help you. Thanks to Emergence AI for partnering with me on

this video. If you've watched this channel at all, you know I'm bullish on agents, and especially agents that can accomplish real-world tasks for you. That's why I'm excited to tell you about Emergence AI. Emergence AI just launched their enterprise-grade multi-agent

orchestrator, and they showed off the first demo of a real-world use case where these agents can actually browse the web on your behalf. This is enhanced web automation. This means multiple agents can go out and dynamically interact with different elements on the web under this intelligent

orchestration to bring human-like interaction and navigation, but at machine-level scale. And what's really cool about this is these agents can actually perform complex and sophisticated web interactions that previously required a human. They can navigate dynamically loading menus, fill out forms, adjust settings, process

embedded files, and extract relevant data from PDFs and HTML. Emergence AI's orchestrator offers a combination of design-time flexibility and runtime determinism, which basically means that these agents can heal themselves. So if it makes a mistake along the way, it can figure it out and then succeed on the

next try. And Emergence AI has put a huge emphasis on privacy and security. They offer a fully hosted solution where you can access it via API, or you can host it on your own virtual private cloud. So if you're an enterprise business and you're looking to automate a lot of your

processes, Emergence AI is a great solution. Integrate their agent API and seamlessly orchestrate multiple agents to accomplish tasks for you and your business. This includes interacting with both modern and legacy enterprise applications. So Emergence AI is just starting to invite developers to try out their

platform. Definitely check them out; tell them I sent you, of course! Go to their website, emergence.ai, or simply email them: contact@emergence.ai. I'll drop all of the links in the description below. So thank you again to Emergence AI for partnering with me on this video. Now,

Back to the video. All right, so I already talked about Gemini's ability to navigate complex user interfaces, and that's what Project Mariner is. It is Google's foray into giving agents the ability to actually control your browser, and it comes in the form of a Google

Chrome extension. So it is a research prototype; it is experimental; it is not publicly available, but hopefully it is soon to beta testers because I definitely want to test it out. And right here it says Project Mariner achieved a state-of-the-art result of 83.5% working

as a single-agent setup. So basically, you gave it a task to accomplish on the web, and it was able to do so. This is the future of agents; I could not be more sure. Now we already know Operator from OpenAI should be coming out in the new

year, maybe during the 12 Days of OpenAI, we'll see. We saw Runner, which is a similar project to navigate the web, and we've seen Claude compute use. So really, giving agents a way to control your computer, control your browser, is definitely coming soon. And then next,

they also released Jewels, which is interesting because Devon was just released publicly this week as well. I'll get to that in a moment, but Jewels is agents for developers, and it integrates directly into your GitHub workflow, which is nice, and you can just tag it and let

it accomplish things for you. It can tackle an issue, develop a plan, and execute it all under a developer's direction and supervision. So very similar to GitHub workflows, very similar to Devon, very similar to Pygmalion and CodeBuff, and a lot of other projects that are just making it so much easier

for developers to accomplish so much more, and then, in a surprise announcement, they're also allowing agents to watch you play video games and actually give you tips, which seems kind of wild to me. I did not expect this. So, here it says Google DeepMind has a long history of

using games to help AI models become better at following rules, planning, and logic. Just last week, for example, we introduced Gemini 2, our AI model that can create an endless variety of playable 3D worlds, all from a single image. Now, they've built agents using Gemini 2 that

can help you navigate through a virtual world, and it can reason about the game based solely on the action on the screen. They're collaborating with one of my favorite game developers, Supercell. I love Brawl Stars and I love Clash Royale, and so these agents can basically watch

you play and give you suggestions. So they are really thinking about putting Gemini 2.0 in everything, and I've said this a few times, but not only that, they're putting it in embodied robots in the real world. So we'll see. I mean, it

seems Gemini 2.0 is very impressive. So that's the summary of all of Gemini's updates. Let me know what you think in the comments below. I would say I'm very impressed, but I want to know from you. Let me know. All right, since we're

talking about Google, let's talk a little bit of drama now. It seems, according to the information, Google has asked the FTC to basically end Microsoft's deal with OpenAI, and specifically their cloud deal. Now, the whole deal between Microsoft and OpenAI is weird to say

The least, and all of it really hinges on what OpenAI's definition of AGI is, because as soon as they hit AGI, the entire deal changes pretty much overnight. Google recently asked the US government to break up Microsoft's exclusive agreement to host OpenAI

technology on its cloud servers. Exclusive deals aren't necessarily illegal, but companies that buy OpenAI technology through Microsoft may face new costs if they don't already use Microsoft servers to run part of their business. Microsoft gets a 20% cut of OpenAI's revenue and, as you probably

know, they also own 49% of the overall company. And you've probably already heard OpenAI transitioning to being a for-profit, so there's just so much going on with the corporate strategy of OpenAI and Microsoft, and we're going to see how all of this plays out. Now, this is

all at a time where the US government is looking very closely at Google and potentially, and it seems likely, going to break them up and maybe they're going to spin off the Chrome browser. I don't actually think we have the final details yet, but it's interesting how all of

these massive tech companies are all aggressively playing legal battles. Next, moving on from Google, we're now talking about General Motors. Now, when I was in San Francisco for about a decade, I remember this little company that started called Cruise, and they made autonomous vehicles, and they were a

really popular company within that insular environment of Silicon Valley, and then they were acquired by General Motors. Now General Motors is shutting it down, which is kind of crazy because they were bought for billions of dollars. GM plans to realign its autonomous driving strategy and prioritize development of

Advanced driver-assistance systems are on a path toward fully autonomous personal vehicles. So, rather than having an autonomous fleet of taxis, for example, they're betting more on personal autonomy—basically, your own car driving itself. This is both surprising and not so surprising. Whenever a non-tech company

acquires a hardcore tech company, I haven't really seen it work out all that well many times. Now, if you can think of a good example, let me know in the comments. Now, it's definitely disappointing to see. I'm excited for Tesla's robotaxi. I know Google has Waymo,

there's this other company, Zoox, which looks really cool. So there's definitely a lot of competition out there still, but as always, more competition is better. All right, so I talked about it earlier; let's talk about Devon. Devon is now publicly available, but there's a catch: it's

expensive—$500 a month gets you Devon. Now, if you put it in context of what it is actually delivering in terms of value and time savings, maybe it's not expensive. If you just think about it as a junior developer, it's actually quite

cheap at $500 per month, $6,000 per year. Devon seemingly is very impressive, but transparently, I have not tested it myself yet. I do plan on doing it; I just haven't done it yet. And as part of their announcement, they actually linked to a

full Devon solution for a GitHub issue, and the GitHub issue happens to be for mCP (model context protocol), which is from Anthropic. So it's kind of cool to see this. So this person on December 6 says, "Hi, please figure out a good solution for"

This issue linked the issue. Use the local copy of the inspector repo; don't make a PR yet. Devin starts doing it, grabs everything, makes a plan, and executes on the plan, pushes the code, and creates a PR. All of this is done autonomously; very impressive, so very

cool interface, very easy to use seemingly. But I always look at it and think, what is their differentiator? If these models are publicly available for any developer to build on top of, what are they really doing differently? Do they have a special version of the model?

I don't think so. They definitely have a really cool interface; they probably have a lot of agentic scaffolding on top of the model, but I don't know how far that gets you. We'll see. Either way, seems very cool. Congrats to Dev on the public

launch. All right, next, it seems Gro has a new image model; it's called Aurora, but then they removed the Aurora title. But either way, it's out. It can create people, famous people, and it looks really accurate, really high quality. It is an autoregressive mixture

model, a mixture of experts network trained to predict the next token from interleaved text and image data; that is Aurora. So let's take a look at some examples. So here's the locked SR-71 Blackbird in an abstract style. Here's the Optimus robot wearing an Xmas

costume. Here is a Grock logo, some flowers, which looks really good; an origami Cybertruck. Here's Jackie Chan in Donald Trump's hairstyle. So it obviously has no problem reproducing celebrities and other well-known people. So I've seen Bill Gates, I've seen Donald

Trump, I've seen Kamala Harris, I've seen everything, and it doesn't refuse ever. And I think Grok is kind of known as being the most permissive in terms of what it will do for you. Google was really on a roll this week; they also

announced Willow, which is a completely game-changing new quantum chip. Quantum is not something I'm very familiar with, but I'm starting to learn more, and I definitely want to talk about it on this channel. If you want to hear about it, let me know. So, quantum chips

are able to compute certain types of use cases infinitely faster than traditional CPUs or GPUs can. And I'm not going to get into the details of how they do that, but one of the biggest problems of why quantum computing hasn't gone mainstream is because of the error rate, and

previously, as the number of qubits—essentially, the bits of the quantum computer—increased, the errors increased. And so, at a certain point, it was just unusable. But now Google released Willow, which actually has the opposite effect: as you increase the qubits, the error

rate decreases exponentially. This is a fundamental unlock for quantum computers and has a lot of potential consequences for the entire world, whether we're talking about research or weather prediction or encryption. All of your passwords might be at risk; cryptography in general—crypto, Bitcoin, Ethereum—these

things might be able to be just, quote-unquote, 'solved' by quantum computers. Now, here's the good thing: it is extremely expensive, both resource-wise and expertise-wise—basically everything—to create a quantum computer. There's only a handful, or less, companies in the entire world

That can actually pull this off, and only one so far has figured out how to get rid of those errors really well. So we're not anywhere close to some hacker in a basement being able to build a quantum computer and break everybody's passwords, so don't worry about that, but...

a really cool update nonetheless. Listen to this stat: Willow performed a standard benchmark computation in under 5 minutes that would take one of today's fastest supercomputers 10 septillion years—that's 10 to the 25th, a number that vastly exceeds the age of the universe. So it's

basically impossible to compute on traditional computing, and it only took five minutes. And if you have any articles or books you suggest that I read to learn more about quantum computing, let me know down below. All right, next, it seems like December is AI

month, because there have just been so many updates and releases. Of course, Zuck has something to say; they have released Llama 3 37B, and he also talks about the future of AI. Let's watch. All right, hey guys, I've got our last big AI update of the

year. Our goal at Meta is to build general intelligence and open-source it, that way everyone benefits. Meta AI now has nearly 600 million monthly actives and, as promised, is on track to be the most used AI assistant in the world by the end of the year. If you haven't

gotten a chance to try voice mode yet, try it; it's awesome. Now, I started 2024 talking about how we had a bunch of H100s, that this was going to be a big year for open-source AI, and it has been. Llama has quickly become the most

adopted model with more than 650 million downloads, and it is starting to become an industry standard. We have one more release for the year: Llama 3.3 is a new 70 billion parameter text model that performs about as well as our 405 billion parameter model, uh, but now it is easier and more efficient to run. So that is the last Llama 3 release; the next stop is Llama 4.

And you know, if we started the year talking about the size of our clusters for training Llama, I want to start to wrap the year by doing the same. Uh, we just announced that we were building a 2+ GW data center in Louisiana that we're going to use to train future versions of Llama. Uh, we are in this for the long

term, and we are committed to building the most advanced AI in the world. All right, thank you for a great year so far. Looking forward to sharing more soon. All right, so let's look at Llama 3 37B, because there's a lot here. It is better

performing than 405B, but easier and more cost-efficient to run. So we can see the benchmarks right here. Here's Llama 3 17B and Llama 3 37B, and it looks like a modest improvement from 3 17B, but the best part: open source, so

you can download it, play around with it, and use it, and it has a very permissive license. All right. And then next, this happened a little over a week and a half ago, so it's kind of old news, but I just want to mention it quickly:

Tech investor and operator in Silicon Valley has been chosen by President Trump to be the AI and crypto czar for the United States. So, kind of interesting. I'm a big fan of the All-In podcast; I watch it pretty religiously. And now seeing David Sacks being the head of

such an important part of the government as it relates to AI and tech and cryptocurrency, I have mixed feelings about it, but we'll see. I definitely like that he chose somebody that is very technical, very forward-thinking. Sacks was also PayPal's COO, kind of the founding

era of PayPal. He built Yammer and sold it for billions. He founded Craft Ventures, which has made a number of investments in every area of tech, but mostly known for SaaS. And so we'll see how it plays out. And so that's it for

today. A lot of news! I know, a lot of cool stuff. Of course, we still have multiple days left in the 12 Days of OpenAI, so I'll be here for it. I'll be reporting to you. If you enjoyed this video, please consider giving a like and subscribe, and

AI News: Gemini 2.0, Devin, Quantum Computing, Llama 3.3, and more!

Artificial Intelligence (AI), Open Source, Generative Art, AI Art, Futurism, ChatGPT, Large Language Models (LLM), Machine Learning, Technology, Coding, Tutorials, AI News, and more

** Exclusive Pinecone Partner **

Matthew Berman

제미니 2.0 출시와 AI 경쟁에서 구글의 역할에 대한 강조.

Gemini 2.0 Flash는 성능과 속도 면에서 Gemini 1.5 Pro를 능가합니다.

멀티모달 입력/출력 기능(이미지, 비디오, 오디오, 텍스트 음성 변환).

기본 Google 검색 통합 및 코드 실행.

Gemini 2.0 Flash의 우수한 성능을 보여주는 벤치마크 결과.

개발자 및 Gemini AI 어시스턴트 앱에서 사용할 수 있습니다.

프로젝트 아스트라와 에이전트 AI

카메라 입력을 이용한 프로젝트 아스트라의 세계 이해 기능.

잠재적인 사용 사례와 시각을 갖춘 고급 음성 어시스턴트와의 비교.

개선 사항: 대화, 도구 사용, 메모리 및 지연 시간 개선.

제한 사항으로 언급된 안드로이드 독점성.

이머전스 AI의 엔터프라이즈급 멀티 에이전트 오케스트레이터.

여러 에이전트가 동적으로 상호 작용하는 향상된 웹 자동화 기능.

이전에는 사람이 직접 수행해야 했던 복잡한 웹 상호작용을 수행할 수 있습니다.

자가 치유 에이전트와 개인 정보 보호 및 보안에 중점을 둡니다.

API를 통한 호스팅 솔루션 또는 기업용 프라이빗 클라우드에서 사용하세요.

프로젝트 마리너 및 기타 에이전트 AI 프로젝트

프로젝트 마리너: 상담원이 브라우저를 제어할 수 있는 Google Chrome 확장 프로그램입니다.

단일 에이전트 웹 작업 완료율 83.5%의 최첨단 결과.

OpenAI 및 기타 유사한 프로젝트에 대한 논의.

Jewels: 개발자를 위한 에이전트로 GitHub 워크플로와 통합됩니다.

비디오 게임 플레이를 보면서 팁을 제공하는 상담원.

Microsoft 및 OpenAI에 대한 Google의 FTC 요청

구글이 FTC에 Microsoft와 OpenAI의 거래를 중단해 달라고 요청했습니다.

OpenAI의 AGI 정의와 거래에 대한 의미에 집중하세요.

Microsoft의 매출은 20% 감소하고 OpenAI의 소유권은 49% 감소했습니다.

미국 정부의 구글에 대한 조사와 잠재적 해체 가능성.

크루즈 운항을 중단하는 제너럴 모터스

제너럴 모터스의 자율주행차 자회사인 크루즈의 폐쇄 결정.

첨단 운전자 지원 시스템으로 전략을 전환합니다.

자율 주행 택시보다는 개인 자율 주행에 집중하세요.

자율주행차 분야의 다른 기업에 대한 논의.

Devon은 월 $500의 비용으로 공개적으로 사용할 수 있습니다.

Devon의 가치 제안과 비용 효율성에 대해 논의합니다.

Devon이 Anthropic의 mCP에 대한 GitHub 문제를 해결한 예시입니다.

Devon의 차별화 요소와 경쟁 우위를 분석합니다.

Grok의 오로라 이미지 모델 및 기타 AI 발전 사항

Grok의 새로운 이미지 모델(오로라)과 그 기능.

유명인을 포함하여 모델이 생성한 이미지의 예입니다.

Grok은 콘텐츠 제작에 있어 관용을 베푸는 것으로 정평이 나있습니다.

구글이 새로운 양자 칩인 Willow를 발표했습니다.

윌로우가 다양한 분야와 암호화에 미칠 수 있는 잠재적 영향력.

양자 컴퓨팅에 필요한 높은 비용과 전문 지식에 대해 논의합니다.

기존 슈퍼컴퓨터와 비교한 Willow의 벤치마크 성능.

메타의 라마 3 37B 및 향후 AI 계획

메타의 라마 3 37B 출시와 오픈소스 성격.

메타의 목표는 일반 인텔리전스를 구축하고 오픈소스화하는 것입니다.

라마는 6억 5천만 건 이상의 다운로드를 기록하며 업계 표준으로 채택되었습니다.

라마 3 37B의 성능은 훨씬 더 큰 모델과 비슷하지만 더 효율적입니다.

고급 AI 구축과 데이터 센터 확장에 대한 Meta의 노력.

데이비드 색스, AI 및 암호화폐 최고 책임자 임명

데이비드 색스가 미국의 AI 및 암호화폐 총재로 임명되었습니다.

데이비드 색스의 배경과 경험에 대한 토론.