Major AI Announcements: Microsoft's Agents and New Models

Microsoft is revolutionizing the corporate landscape with new autonomous agents through Co-pilot Studio.

### Major AI Developments: Microsoft, IBM, Anthropic, and More
* 🚀 Yesterday marked a significant day in artificial intelligence news with numerous announcements, starting with Microsoft unveiling their **Co-pilot Studio for creating and running autonomous agents** in Windows environments, set to **enter public preview next month**.
* 💼 Microsoft is introducing **10 new autonomous agents** for Dynamics 365, targeting sales, service, finance, and supply chain teams, and believes **millions of agents will soon infiltrate the corporate workforce**.
* 🔥 In contrast, Salesforce CEO Mark Benioff criticized Microsoft's efforts, labeling Co-pilot as a **"flop"** and claiming they lack the necessary **data and security** for effective corporate intelligence, humorously dubbing it **"Clippy 2.0."**
* 📊 IBM also made headlines by releasing multiple open-source models, including Granite 3.0, which features **new techniques for enhancing core models** without traditional fine-tuning.
* 🤖 Anthropic introduced Claude 3.5, showcasing its new **computer use tool**, which allows AI models to **control computers**, albeit with some **experimental quirks**.
* 🌍 Meta contributed significantly to open-source projects, launching features like **Segment Anything 2.1**, which allows for **easy image segmentation**, alongside a new **text-to-speech language model**.
* 💰 Former OpenAI CTO Mira Murati is rumored to be raising **over $100 million** for a new venture focused on proprietary AI models, signaling **more competition in the industry**.
* 🎨 Lastly, innovations from companies like Stability AI, Runway, and 11 Labs are democratizing creative tools, enabling users to **generate high-quality media content with ease**, making it an **exciting time for creators**.

Yesterday may have been one of the biggest days in artificial intelligence news since the beginning. There were numerous announcements, and we're going to cover everything from yesterday and the past few days. There's so much stuff; let's get right into it. First, Microsoft released agents. They've now released previews of their agent studio called Co-pilot Studio, where you can create agents, run agents, and basically put agents into every aspect of your Windows environment. And they are betting big on it. And there's a few interesting bits from the announcement. Let me read a few parts. The ability to create autonomous agents with Co-pilot Studio will be in public preview next month, so not quite released yet, but very soon. Then they're introducing 10 new autonomous agents in Dynamics 365 to build capacity for every sales, service, finance, and supply chain team. So they are building agents for the enterprise environment. And based on this blog post, based on a keynote Satya Nadella, the CEO of Microsoft, just gave, based on another post that Microsoft just released, they are betting that

agents are going to infiltrate every aspect of the corporate environment. They believe that millions of agents are going to enter the workforce in the next few years, and I kind of agree with them. It's probably going to be pretty simplistic at first, a lot of basic automation, but as the models get better, as the agentic frameworks get better around the raw intelligence, we're just going to see these agents become more and more proactive rather than just being reactive and doing the task that is assigned to them in that moment. But not everybody thinks the Microsoft announcements are awesome. In fact, Mark Benioff has been flaming Microsoft about all of their launches. And if you're not familiar, Mark Benioff is the CEO of Salesforce. He definitely has a very strong personality. And if you remember way, way, way back at the beginning of Salesforce, it started with a very famous motto: No software. Previously, all software was delivered on-prem and you would install it and it would become stagnant. And he was really one of the original people to bring software to the

cloud SAS, and he had this famous pin where it was exactly like this, but rather than saying co-pilot, it said software. But now he's using it again to say co-pilot. Look at how aggressively he is going after Microsoft. Microsoft rebranding co-pilot as agents, that's panic mode. Let's be real, co-pilot's a flop because Microsoft lacks the data, metadata, and enterprise security models to create real corporate intelligence. Now, that's not really true. Microsoft has all of the data. They are in essentially 98% of all enterprise companies right now. Every business uses Microsoft in some way, so they have the data. And to say that they don't have the security, maybe, but really, they have the talent to build the security if they don't already have it, which is up for debate. And he's calling it clippy 2.0, and I think that's hilarious. I really actually love this corporate jabbing, even though it's all puffery, and Mark Benioff might not actually believe the things he's saying.

and of course he's coming up with competing products with agent force. So, you know, as soon as co-pilot Studio comes out, I'm going to play around with it. I'll let you know how it is. Next, IBM has released multiple open-source open-weight models to the world. I was just in New York last week visiting IBM. They showed me a bunch of previews of these announcements, and now they're here. So, we have Granite 3.0 8B and 2B. We also have a mixture of experts version of the Granite model. And again, completely open source, completely open weight, Apache 2.0 license. They also have a new technique to add knowledge to these core models that isn't really Rag and isn't really fine-tuning. It's somewhere in between, and I have an entire video coming out going over the granite model, going over all of these techniques coming soon. Next, of course, the biggest news from yesterday, Anthropic released Claw 3.5 Sonet, the new version. They also

announced Claude 3.5 Hau, which is their newest small model but better than clad 3.0 Opus, which is kind of nuts to think about. Opus was their biggest model, and 3.5 Sonic new is performing extraordinarily well. If you haven't already seen my video about it, check it out. I'll drop a link in the description below. I also did a full test of cloud 3.5 Sonic new. Alex is putting the final touches on the edits, and we should release that in the next day or so. So, if you're not already subscribed, make sure you subscribe so you can see that video and see how this new awesome model does. And the most compelling announcement from yesterday from anthropic was the computer use tool, which is absolutely mind-blowing. Basically, it's anthropics' attempt to give these AI models the ability to control your computer. We've already seen open-source projects attempt to do it, like open interpreter and a few others, but it hasn't always worked well. And now anthropics giving it

a try. They have a caveat with it: it is experimental, and it makes mistakes. And they've actually shown examples of weird behavior, like when the model all of a sudden stopped doing what it was tasked to do and started researching Yellowstone out of nowhere. Kind of cool, kind of weird. So, it's an API. You can try it out already. I haven't created a video about it yet, but if you want to see a tutorial, or if you just want to see me play around with it, let me know in the comments. Thanks to the sponsor of this video, Vulture. Reap the benefits of the world's largest independent cloud provider when you bring your GPU workloads over to Vulture. They have the latest Nvidia GPUs spanning 32 locations across six continents. Vulture delivers industry-leading price to performance and serious accessibility and reliability. Vulture's global fully composable cloud infrastructure moves your applications closer to your users and frees you from vendor lock-in, allowing you to bring your own networking and database solutions. And if you need to scale beyond just a single

cluster vulture's Kubernetes engine allows you to take full control over your deployment, offering up a 100% free control plane. So, if you're tired of waiting for GPUs from other providers, make sure to use Vulture. You can deploy at any scale immediately, and they have H100s, L40, and more available right now. You can get a fraction of a card or fully dedicated bare metal systems, which gives you full control over your hardware and your throughput. They also have one-click installation of all the applications you might need for advanced machine learning workloads, allowing you to get up and running in minutes, not hours. So, experience the Vulture difference. Don't get bogged down by severe wait times or limited locations. Try it free today with a $300 credit for your first 30 days when you visit GetVulture.com/Burman and make sure to use code Burman300 at checkout to get that credit. Thanks again to Vulture for sponsoring this video. Next, last week, Meta released a ton of open-source projects. I continue to be

impressed with Meta's open-source contributions. So, here are all of the features segment anything 2.1. If you haven't already seen that it was out, you can basically take any image or video, click on it, and it automatically will segment anything in the image. So, if you want to take a person out of the image, if you want to take a balloon or a building or anything at all, it's so simple to do and highly accurate. Then, they also released Spirit LM, which is an open-source language model for text-to-speech. And then, they also released a bunch of highly technical projects aimed at making training easier, making inference faster, and so on. So, definitely check it out. I'll drop the link to this blog post in the description below. Next, former CTO of OpenAI, Mira Murati, fresh off just leaving OpenAI, is already rumored to be raising a bunch of money and starting a new company and hiring people. The talks are in the early stages, and Mira Murati's new venture could raise over 100 million given her

reputation and the capital needed to train proprietary models. And so, of course, she's building proprietary models. She might build products on top of those models. But look, if anyone has the knowledge to do it, it's definitely the former CTO of OpenAI. And she has the reputation to hire the best people, raise a ton of money. So, you know what? I'm all for it. The more competition, the better. Next, a Chinese copycat company of the Optimus robot has released a new video and a new humanoid robot that seems to be pretty good. It looks a little bit awkward at times, and it's definitely not as smooth as the Optimus robot, but cool nonetheless. And again, the more competition, the better. Now, a lot of people are saying this is almost an identical copy of the Optimus robot. It definitely looks pretty similar, but I don't know if it's a copy necessarily. Plus, the Optimus robot hasn't been around that long. This company hasn't been around that long. So, the idea that they maybe stole secrets

and then reproduced it in such a short period of time seems unlikely to me. But you know what? Again, I love humanoid robots. I love all the progress, and good for this company NeXT. Stability AI released stable diffusion 3.5, the new version of their text-to-image generation model. They have stable diffusion 3.5 large and stable diffusion 3.5 large Turbo, and they also said they're going to release a medium-sized version on October 29th. Now, the great thing about stable diffusion is it's open source. You can download it, you can run it on your computer, and anytime a company contributes to the open-source community, I am very thankful to them. So here are some examples. These people look incredible. They look real. I wouldn't be able to tell the difference, and the light is great, the hair is fantastic, everything looks right. Now, obviously, there are no hands in these photos, so that's really the seemingly hardest thing for AI to get right. Here are some other examples. This is obviously a piece of art. This looks like a pretty

realistic mug. Although the handle of the mug looks a little awkwardly positioned. And then another piece of art right there. And you can access these models through the stability AI API, through replicate, through comfy UI, locally on your computer, and from Deep infra. And if that's not enough, AOG released a brand new feature called AOG canvas. It's basically like having an infinite canvas board. You start with an image, and you can keep adding to it or adding around it. And yeah, it just seems really cool. Bring your face or brand visuals to ideogram canvas and use industry-leading magic fill and extend to blend them with creative AI-generated content. So, it has a brand new interface. Here's what it looks like. You can generate images, select the images, expand on them, add to them. It's really cool. Here's what magic fill looks like. So, you can take an image, you can select part of it, and basically change it to be anything that you want. Here is extend, which is an outpainting tool. So again, you take the

image, and then you can add anything you want around it. Andre Karpathy says, Love it, eager to try, and I am as well. I can't wait to try this next LM Studio released another awesome update, 0.3.5, and now it has headless mode. So, very similar to how AMA Works, where there's basically no interface, you get the interface with LM Studio, but then you can essentially make it disappear and just use it in your taskbar, for example. And it's just an API at that point. So, if you're a developer, that is perfect for you. You know I love LM Studio, I'm an investor in LM Studio, and I really do use it all the time. Here, you can minimize to the system tray, so you don't have to keep the UI open if you don't want to, and again, that is perfect for development efforts. Next, one thing the CEO of Perplexity, Rvin, said that they are adding in the ability for their models to think, and most likely they're using the 01 model model now, and so if

you're doing deep research or anything requiring that level of intelligence, which you know how I feel about that. You can obviously use that feature now, the thinking feature. So, it is a reasoning-powered search agent; that is what they're calling it. But not only that, now that Clad 3.5 son is out, they have it available. If you're a pro user in perplexity, you can use that new model. And of course, I turned it on. I really don't see much of a difference between the models in perplexity. Perplexity usually is just really good, and I don't care about which model it's using, but it's cool to be able to try it out nonetheless. And one thing that's super fascinating to me, and I don't really understand how they do it, is how do they just add these models with no issues? The day that the model's announced, they have it available in perplexity. How do they not have any issues? How do they not have to redo the prompting or the caching or

anything else. It just seems like they're ready to go, and whatever they've built, it's a very robust system. Next, we have a brand new open-source text-to-video model. It is called Moi 1 and is by Genmo. I think it's Genmo, Genmo AI, Genmo, whatever. And so, it looks really good, and everything stays consistent, and the physics looks good. And I haven't played around with it more than just looking at the demo videos, but if you have, let me know what you think in the comments below. It's open-source, so you can technically download it and get it running on your own computer, which you know I love. And if you want to try it, you can try it right now for free. And of course, here's the model available on GitHub if you want to download it and play around with it. And another one, Runway, has come out with a brand new feature. Now, Runway is not open-source, but it's still cool nonetheless. They just introduced Act One, which is a new

way to generate expressive character performance inside Gen3 Alpha using a single driving video and character image. Basically, you take your face or a video, anything about yourself, and then you can use text-to-video to overlay on top of it, and you're basically animating the character very similar to how Gollum was portrayed by a real human. But they needed a ton of technology with all of this face tracking and all of this really expensive technology. But now, you just need a video of yourself, and that's it. So, really, the cost to create incredible videos is coming down drastically. So, very cool. Congrats to Runway on this launch. Next, a quick story. XAI finally has an API available, and it's pretty competitive pricing. If you like the Grok models, definitely try it out. We know we're getting another Grok model very soon, and it has a single model, the Grok Beta, priced at $5 per million input tokens and $15 per million output tokens. So, if you're a developer and you need another model in your

quiver of models for your AI application. Definitely check this out next, and I love all this generative AI coming out right now. 11 Labs just released the ability to describe a voice, and then you can use the voice with a script. So, rather than having to clone an existing audio file or voice, you basically just describe what you want, and then you can use it. So, here's an example: a large yeti with a deep, rumbling voice. Let's listen. I have guarded these sacred peaks since before your ancestors first dreamed of climbing them. Here's a scary witch with a hushed voice. The moon whispers secrets tonight. The stars have told me of your fate. So, again, really awesome. The amount of creative tools that people are getting today is going to allow anybody to create incredible movies, TV shows, podcasts. It's just such an exciting time to be a creative person. So, that's it for today. Those are all the stories. It's only Wednesday as I'm recording this, so who knows what's going to happen the rest of the week. Maybe I'll create

another news video this week because this week has been absolutely bonkers. So, if you enjoyed this video, please consider giving a like and subscribe, and I'll see you in the next one.

AI News: Copilot Agent Builder, IBM Granite 3.0, NEW Claude Sonnet, Open-Source Text To Video!

Artificial Intelligence (AI), Open Source, Generative Art, AI Art, Futurism, ChatGPT, Large Language Models (LLM), Machine Learning, Technology, Coding, Tutorials, AI News, and more

** Exclusive Pinecone Partner **

Matthew Berman

Microsoft has launched previews of its Co-pilot Studio, aiming to create and run autonomous agents for every aspect of the Windows environment.

The company is introducing 10 new agents in Dynamics 365 to support sales, service, finance, and supply chain teams, with a public preview of agent creation set for next month.

However, Salesforce CEO Mark Benioff has criticized Microsoft's efforts, claiming their rebranding of Co-pilot as agents is a sign of panic and questioning their ability to deliver real corporate intelligence.

Co-pilot Studio is launching soon, and IBM has released multiple open-source models, including Granite 3.

5 Sonet and Hau models have been announced, with the Sonet performing exceptionally well.

The most notable update from Anthropic is the experimental computer use tool, giving AI models the ability to control your computer.

Vulture's Kubernetes Engine and Meta's Open-Source Contributions

Vulture's Kubernetes engine offers a 100% free control plane and immediate deployment at any scale, with H100s and L40s available.

They provide full control over hardware and throughput, along with one-click installation for advanced machine learning applications.

Meta recently released several open-source projects, including Segment Anything 2.

1 for image and video segmentation, Spirit LM for text-to-speech, and other technical projects to improve training and inference.

Stability AI has released stable diffusion 3.

5, with various model sizes and an open-source approach.

AOG has introduced AOG canvas, an infinite canvas board for image generation and expansion.

5 includes a headless mode for developers, allowing the interface to minimize to the system tray.

Perplexity has introduced a reasoning-powered search agent with the release of Clad 3.

5, allowing pro users to try out the new model.

Genmo has launched an open-source text-to-video model, Moi 1, which offers consistent physics and is available for free download.

Runway's new feature, Act One, allows users to generate expressive character performances using a single driving video and character image, significantly lowering the cost of creating impressive videos.

11 Labs has launched a new feature that allows users to describe a voice and use it with a script, eliminating the need to clone existing audio.

The tool offers creative voice options, like a deep-voiced yeti and a hushed witch, enabling users to create unique characters.

The surge of generative AI tools is empowering creatives to produce incredible movies, TV shows, and podcasts, making it an exciting time for artistic expression.