AI Innovations: Tools, Previews, and Partnerships

Odyssey, a Hollywood-grade visual AI, aims to produce glitch-free and stunning visuals, developed by a team with experience in self-driving cars and video games.

### AI Weekly Recap: August 2022
* 🎬 ** Odyssey**: A new Hollywood-grade visual AI tool, promising **glitch-free and mind-blowing visuals**, is in development by a team with experience from Cruise, WHMO, Tesla, and the Video Game World.
* 👄 ** Live Portrait**: A viral tool that animates images using driving videos is available on GitHub and a Hugging Face space, with some **limitations for bearded individuals**.
* 🎨 ** Paints Undo**: A new tool that **reverse engineers finished images** to show how they were created, currently available on GitHub and soon to be on Google Colab.
* 🌐 ** PO Previews**: A new feature in the PO chatbot allows for **interaction with web applications directly in chats**, powered by models like **CLAE 3.5, Sonnet GPT 40, and Gemini 1.5**.
* 🔗 ** Artifacts Sharing**: Anthropic's Artifacts feature, which generates code based on prompts, is now **shareable**, allowing others to **interact and build** on the generated code.
* 🧠 ** OpenAI has blocked access to China, potentially hinting at the **imminent release of GPT-5**, while also seeing changes in its board membership and forming **new research partnerships**.
* 📊 ** Stability AI updated its license terms for Stable Diffusion 3, now allowing **free commercial use for revenue under USD $1 million**, similar to Unreal Engine's licensing model.
* 📱 ** Samsung Unpacked**: Samsung announced a range of new gadgets with AI features, including the **Galaxy Z Fold 6**, **Galaxy Watch 7**, **Galaxy Ring**, and **Galaxy Buds 3 Pro**.
* 🤖 ** Gemini Robot**: A robot navigated the Google DeepMind offices using the **Gemini model**, combining **vision, language, and action** to act as an AI tour guide.

well, AI's definitely had a little bit of a slowdown for the summer, but that doesn't mean that there hasn't been some really cool stuff in the AI world happening that we can talk about. Let's start by talking about the newest AI video tool that we've been getting a preview of, a tool called Odyssey. Now, Odyssey claims to be Hollywood-grade visual AI. Here's some of the clips that it showed off that it can generate, like this drone-looking shot, this stickies these islands. I'm not sure if that personal was generated or not, but those landscapes and most of this b-roll that we're seeing here was created with this Odyssey tool. Now, this isn't something that's publicly available yet, kind of like Sora, and their goal is to make it capable of producing glitch-free and mind-blowing visuals. Now, they say here that they're training four generative models that enable full control of the core layers of visual storytelling: high-quality geometry, photorealistic materials, stunning lighting, and controllable motion. And as this little

animation here shows you each model will enable you to precisely configure the minutia of your scene. They claim they're working alongside Hollywood to shape the technology. The team behind this project has worked on some big things, specifically mostly in the self-driving car area like Cruise, WHMO, and Tesla, but also from the Video Game World. And they're working alongside artists who have worked on things like Dune 2, Godzilla, the Creator, Avengers, and more. So pretty solid team. I'm excited to learn more about this one as it comes out. We're having this sort of Renaissance in AI video lately where we're getting all sorts of really cool AI video tools to use and previews of other ones that hopefully we'll be able to use soon. If you've been on Twitter SLX recently at all, you've probably seen this going a little bit viral. It's called Live Portrait. It's a tool that gives you the ability to upload a driving video and a Driving Image and then animate that image to look like the

video. And what's so cool about this is it's available right now. You can download the code on GitHub and run it locally if you'd like. But they also set up a Hugging Face space where you can actually use it completely free. I will make sure it is linked up below so that you can easily find it. And here's what it looks like in practice. I made this image here with Leonardo. I uploaded a driving video that looks like this. Or should subscribe to Matt Wolf. And I will tell you right now, it struggles a little bit if you've got a beard. 'Cause this was the output. You can see me talking on the left. But the character on the right is struggling to open his mouth at the same pace that I'm talking. When I start doing these crazy expressions on my face, it actually starts to match up. So if you're real expressive, it works well. But if I'm just talking down here, it actually doesn't look like it's syncing up to my lips very well. And I'm guessing

it's probably because of the beard. I don't know, maybe the hat's throwing it off, but if I had to guess, it's probably the beard. Let's go ahead and select this input image along with this driving video here of this person looking around. Click animate. We get our final output video over here on the left, and then we get a sort of side-by-side comparison video over here on the right, and we can see what it generated. You can see the mouth and the eyes try to mimic what the driving video was doing and apply it to the source image here. Another piece of cool research started circulating this week called Paints Undo, and the idea is you upload a finished image here like this anime girl, and it will actually make an showing you essentially how to draw that image. It's almost like a reverse of what we're getting with AI art generators. You start with a piece of art, and it will reverse engineer how to create that art yourself. So if you make a piece of art inside of Mid Journey or Leonardo

something like that, you can throw it into a tool like this, and then actually get a little bit of instruction on how to recreate that image yourself on paper. And there's all sorts of cool examples here of different anime art, and then showing it reverse-engineered into its initial sketches, including the painting and shading, and all of the steps to get to that image. I'll link up to this GitHub below. You can see there's all sorts of other examples here. It's not just for anime girls, although that seems to be the main use case they're showing off here. Now, this one, the code is available on GitHub right now. You can search out paints undo and find it. I'll also link it up. However, it doesn't have a hugging face space. If you read through the GitHub page, it actually says, because the processing time in most cases is significantly longer than most tasks in hugging face, we personally do not recommend to deploy this to hugging face. What they do say here is one option is to wait for us to release a collab.

notebook. So it sounds like they will be setting up a Google Collab where you'll be able to use this soon. But if you know what you're doing, you can download this code and run it locally if you meet the system requirements. Now, they did say they tested on a 24 GB VRAM Nvidia 490, but it does say it should work on a 16 GB VRAM as well. So, if you're using a 3080 or a 4080 with 16 GB of VRAM from Nvidia, it still theoretically should work. I haven't tested it myself yet, but maybe for a future video. We're still seeing some amazing generations come out from Gen 3. If you're on X or Twitter at all, you're probably getting inundated with people making videos using Gen 3. This was one of my more favorite videos I've seen recently from the Dorr Brothers where they're showing a water slide sliding through all sorts of cities and fire. And I just like it when people figure out this way to create.

this cohesive theme, but make a really long video that looks like it all pieces together well. So I think they did a really, really good job on this video, and I wanted to share it 'cause I was impressed. Today's video is sponsored by Nid AI. Creating high-quality videos can be incredibly time-consuming, from scripting to editing to finding the right stock footage. It's a ton of work, and that's where InVideo AI comes in. Nid is the world's most used AI Video Creator, with over 25 million users around the world. Imagine having a skilled assistant that can handle all of the painstaking and annoying video editing tasks, leaving you free to focus on your creativity. So here's how it works: you start with a simple text prompt, something like a short video explaining why advancements in Robotics are accelerating. You click generate video, give it a little bit of additional details here. Let's make this a YouTube short, and Nid creates a rough draft for you following the prompt that you just entered. You need to hear this if you're

worried about robots taking over the world and from there you're in the driver seat. Want to change the intro? Do it with a prompt. Need better footage for your scene? It's easy. Just click edit, pick the clip you want to swap, and replace it from their high-quality stock video footage. Want to translate the whole video to Spanish? That's easy too. Just type the prompt and click generate. It can even clone your voice for the video. And the best part is, N Video does the task of over 10 tools all combined into a single easy platform. This can easily save you hundreds of dollars a month in recurring fees, and it starts at only 20 bucks a month. Now, I know some people see this AI video stuff as a threat, but I see N Video AI as a way to level up your skills. It allows people like you and me to bring to life creative projects that we may have not otherwise ever had the ability to do so. Want to try it out? You can actually start with N Video AI completely free. But if you are really serious about video

creation. I highly recommend one of the paid plans. It'll remove the watermark, give you access to voice cloning, and gives you access to additional high-quality stock footage. Just go to the link in the description and use my coupon code MW50, or use the QR code that's on the screen right here to get twice the number of video credits in your first month. So check out InVideo AI today, and thanks once again to InVideo for sponsoring today's breakdown. If you use the chatbot PO, it just got a new update this week called previews. It's a new feature that lets you see and interact with web applications generated directly in Chats on PO. Previews work particularly well with llms that excel at coding, including CLAE 3.5, Sonnet GPT 40, and Gemini 1.5. So PO is a subscription-based chatbot, but when you're using it, you can actually choose the model. You're not stuck with just using GPT or CLAUD or Gemini. You get to choose which model you use. And so to me

this seems very much like what Anthropic just released with their artifacts, but it's in Po. And you can use it with multiple different models. So you can see from this clip right here that after it was prompted, it actually generated the code and executed the code in real time right in line with the rest of the chat. So you can actually interact with whatever it built right inside the chat window, and the previews can be shared with anyone via a dedicated link. So if you make a really cool coded-up thing inside of Po and you want other people to use it, you can share a link with them, and they'll get access to it inside of their Po account. And I just mentioned Anthropic and their artifact feature. Well, they actually just made artifacts shareable as well. So that is new as of this week. Artifacts isn't new where you enter your prompt sort of on the left, and then it generates the code and the preview on the right, and then you can interact with it on the right. That's been out for a couple weeks now, but the

ability to actually share that with others. Where others can use it, try it, and then remix it and build on top of it. That's a new feature, bringing it even closer to what we can do with things like custom GPTs that we were getting out of the GPT store. In my opinion, Claud is just upleveling and upleveling and shipping features that just improve the quality of life of using this app. I'm really, really a fan of what Anthropic has been doing lately. And since we're on the topic of Anthropic this week, they also rolled out the ability to evaluate prompts inside of the developer console. So, this isn't on the Claud website. This is in the developer console, which you can find by going to console.anthropic.com. You can see we've got this generate prompt here where we can enter a basic prompt, click generate prompt, and it will make an improved prompt for us. I just had it generate a prompt about generating more prompts. So, let's go ahead and click continue. You can see

that it wrote up this long detailed prompt, and then it gave me a variable of topic so I can plug in whatever topic I want here, and it will wrap this entire prompt around that topic. But what's cool is that we can actually do this in bulk with multiple topics. So if I come over here to evaluate, I can add rows here and give it multiple topics. So let's go robotics, 3D printing, artificial intelligence. And I can tell it to run all, and it's going to run all three of these prompts and just change the one variable for each time. And we can see all of the outputs for each of these topics was generated. But I can also create a second prompt and have it compare the second prompt using the same topic. So this will be really handy to test out a handful of prompts to see which prompts are the best, and also change individual variables within each prompt to see how those change as well. Meta this week also announced a new language model called Mobile LLM. It's a much smaller language model, obviously.

developed for mobile devices. But you can see, according to this chart here, the accuracy seems to be much higher than most of the other mobile models that are out there. All right, let's talk about OpenAI for a minute because there's been a lot of fascinating things happening over at OpenAI. Starting with the fact that OpenAI just blocked access to China. Now, it already was sort of outlawed in China. You weren't allowed to use ChatGPT in China, but people were figuring out how to get around it using VPNs and things like that. And apparently OpenAI has even cut off that loophole. However, it's very interesting because China still has access to Microsoft Azure, and Microsoft Azure has GPT-3 access. So they can still sort of use it, but they have to go through Azure instead of OpenAI APIs. So it's really interesting, and it's got a lot of the AI world speculating. Maybe this is a precursor to GPT-4 coming out. A lot of people think that this blocking of

access to China, but not blocking it from Microsoft, is an indicator that OpenAI is going to launch GPT-5 really, really soon. And they don't want China to have access to GPT-5, but that's just speculation. A lot of YouTubers and people on X are acting like this is fact. It's not a speculation, but who knows, there could be some validity to the idea that GPT-5 is right around the corner, and this is OpenAI just sort of prepping for that to happen. And this news was also kind of interesting from OpenAI this week. If you remember when all the crazy fallout happened with Sam Altman and OpenAI, it was announced that Microsoft was going to get a board member on OpenAI. It was going to be an observer role. They didn't have voting rights, but they were going to have a board member, so they were always sort of looped in. Well, now apparently Microsoft is backing out, saying we don't need that board role. Also, when Apple announced that they were going to use OpenAI Tech.

as part of the new Siri feature with the deal, Apple was also going to get an observer board roll. Well, this week Apple also stepped away and basically said, We're not planning on taking that board roll. The reason these companies are doing this is because there's been a lot of scrutiny around antitrust laws and the government worrying about too big of a consolidation of power in any one AI company. And because that's happening, both Microsoft and Apple are saying, We're going to distance ourselves. We don't want to open ourselves up for more legal government antitrust sort of lawsuits. In other OpenAI news, OpenAI and Los Alamos National Laboratory announced a bioscience research partnership. Now, this partnership could potentially lead to more rapid advancements in innovation in areas like healthcare and bioscience. And along a similar line, Ariana Huffington and OpenAI are now working together to try to transform healthcare. The OpenAI Startup Fund and Thrive Global are jointly funding to build a customized, hyper-personalized AI health coach.

will be available as a mobile app, and also within Thrive Global's Enterprise Products. So imagine like an AI health coach that knows more about you and can provide nutrition advice, exercise advice, mental health advice, and things like that that are specifically tailored to you, your needs, your body type, and you individually. Existing apps don't have this sort of hyper-personalization, so you get a lot of sort of one-size-fits-all health advice. With a combination of AI and this health coach concept, we can sort of more personalize it and more tailor it to individuals' needs because in most cases what works well for one person isn't always the same thing that works well for another person. And this seems like a problem that AI should be able to easily help us solve. Stability AI updated their license terms around Stable Diffusion 3. If you remember, it was non-commercial use only. The website Civii basically said you can't put SD3 models on here because the licensing is confusing. Well, it looks like Stability AI listened to the feedback and updated their licensing terms.

and says, Now you only need a paid Enterprise license if your yearly revenue exceeds USD $1 million. Other than that, if you're under a million a year, you can use the AI models in commercial products or services. So they're kind of following that Unreal Engine model. We can see the breakdown here: non-commercial use remains free, free commercial use appropriate for individual use and small businesses. There's fewer limits and only commercial users need to self-report, and that's only if you exceed revenue of over a million. Stability AI also released stable assistant features. We can see they added a search and replace feature so you can see they uploaded this image with an egg in it, searched out egg, replaced it with dragon. They updated their text to audio here. If you want to use stable assistant, you go to Stability AI, go to Applications, click on stable assistant, and they have a free trial. But pretty much all of these various tools are available inside of this stable assistant. Stability AI used to own Clip Drop. Most of these features were in Clip Drop. They sold Clip Drop, and now it

looks like they're sort of building out their own competitor to clip drop. There was a court ruling this week that suggested that AI systems may be in the clear as long as they don't make exact copies. Now, this specific court case was against GitHub and Open AI, claiming that they were using other people's copyrighted code to generate new code. The court essentially said they couldn't find any clear copyright infringement as long as the output was different than the input and it didn't just clone it or duplicate it. Then it's not a copyright infringement. And since this has been settled this way, although there could be some appeals and things like that, so it's probably not totally over, but it does now sort of provide some precedent for future lawsuits that are trained on copyright material, but the output of the models is different enough that it no longer infringes on the copyrighted materials. It's still very muddy, and I don't know how this is going to play out, but this at least gives a little bit of precedent for

future lawsuits. If you're a fan of the Magnific AI upscaler, which sort of upscales but also can do things like reimagine images and new styles, and actually hallucinate on purpose to make your images actually more interesting looking. Well, they rolled out a Photoshop plugin so you can use Magnific directly inside of Photoshop. That's a new feature that came out just this week. You can find it over in the Adobe Exchange. And quite honestly, I use Magnific quite a bit to help me upscale some of the images that you see on my thumbnails. So, some of these images that you see here may look familiar. That's because I use Magnific all the time to try to improve the look of some of these thumbnails. Now, this isn't brand new news, but I did want to touch on it. That there is a bill called SB 1047 that they're trying to get signed into law here in California that has the potential to severely hinder researchers from actually doing their work. And we recently interviewed Anan Madada from

a16 on the next wave podcast, and he's one of the people out there sort of fighting against this bill. Let me just show you a quick clip from the podcast so you can hear exactly how he thinks this bill is going to harm researchers. Basically, SB147 is a proposed law that's making its way through the California legislature right now. This bill is drafted to attack underlying model researchers, scientists, and developers. Among other things, it's trying to place civil and criminal liabilities on developers of AI models, as opposed to focusing on the malicious users of those models as proposed by this bill. Overseeing these new laws would be a frontier model division, which is kind of like a new DMV they want to form that would have the power to propose requirements on startups, on researchers, on academia that would dictate if a researcher and engineer could ultimately be thrown in jail or not. This bill is now slated for a California assembly vote in August, less than 60 days away. This is a

incredibly dangerous piece of well-intentioned, but incredibly misguided regulation that is trying to make AI safer by focusing on the underlying model instead of the malicious misuses, which is really where we should be focusing. So, I'm not going to dive too much more into that bill on this video here, but that episode of the Next Wave podcast is being released on Tuesday, and Anan does an entire breakdown of the bill, what it means for AI advancements, what we can do to prevent the bill, and what it means for people outside of California 'cause it definitely does affect these companies outside of California as well. So, if you're not subscribed to the Next Wave podcast, it is linked up in the description. I highly recommend you check that out 'cause that's where I get to have long-form conversations with a lot of the builders, innovators, and people doing interesting things in the world of AI. This week, Samsung also held their annual Unpacked event where they announced a whole bunch of new gadgets, and pretty much all of them have AI in it.

example, they announced their Samsung Galaxy Z Fold 6, and we can see here the Galaxy Fold 6 is AI-ready with Samsung's latest AI features, including Circle to search, translate, and transcribe PDF documents, generate AI-based off of people or objects in photos you snap, and a sketch to image feature that turns quick sketches into high-quality images. They also announced the Samsung Galaxy Z Flip 6. The external display has been enhanced with suggested replies from the on-device AI, and it's got AI-powered wallpapers on the display. They showed off the new Galaxy Watch 7 with a new AI-empowered sleep algorithm. It's the first of its kind to be FDA authorized to recognize signs of sleep apnea in its wearers, as well as providing a host of valuable sleep metrics. They showed off their Samsung Galaxy Ring, which looks to be a competitor to like the Aura Ring, which I actually wear myself. It's got little sensors inside of it, but this version of the Ring uses Galaxy AI to generate a comprehensive energy score.

based on your activity level, sleep quality, and other health metrics, the Ring's AI-powered algorithm powers its sleep tracking mode, recording insights such as movement during sleep, sleep latency, respiratory rate, and heart rate, all available each night in the app. And finally, the Samsung Galaxy Buds 3 Pro, Samsung's answer to, like, the AirPods. It's got an interpreter setting that leverages AI to translate foreign language dialogue in real time. That is cool. Come on, that is cool. Can you imagine just putting a pair of AirPods in, talking to somebody in a different language, and then the correct language just being translated in real time right into your ear? That's going to be valuable. So, of new gadgets, pretty much all of them with some sort of cool new AI feature built into them. And that was what was announced at Samsung Unpacked. And finally, here's a robot that navigated the Google DeepMind offices using Gemini. So, it's using that Vision model to see what's around it and navigates through the hallways, making sure not to bump into anything.

the vision model knows exactly where it is and can see around itself to make sure it doesn't bump into stuff. Now these videos, those that are here on this TechCrunch article, don't have any audio, but it does say that it can walk around the office and point out different landmarks with speech. They use what's called a vision language action that combine the environment understanding and common sense reasoning power. And once the processes are combined, the robot can respond to written and drawn commands, as well as gestures. So right now, it's kind of like an AI tour guide. It could roam around a building and point things out to you and give you some information about the things that pointing out. And that's what I got for you this week. Again, it was another week without any major massive huge monumental AI announcements, but a lot of cool stuff is still happening. Almost every single day, there's something interesting to talk about. And I love making these videos at the end of the week and recapping all of the cool stuff that I came across. If you like videos

like this, and you want to see a weekly recap, make sure you like this video. And subscribe to this channel. It really helps with the channel growth, and it also ensures that you see more of my videos and videos like mine inside of your YouTube feed. I also have a website over at futur tools, where I create all the cool AI tools I come across. I share all the AI news on a daily basis as I come across it, and I've got a free newsletter where I share all of the latest and coolest AI and Tech news and advancements and tools. If you're an AI or tech nerd like me, you're going to want to be on that newsletter. We share a lot of cool stuff, and that's what I got for you this week. I really appreciate you. Once again, thank you, thank you so much for tuning in. I record these videos on Thursdays, release them on Fridays, so if there was any news that came out at the end of the day on Thursday or on Friday, that'll likely be in next week's.

video or a video that I released sometime after this one. But I'm going to do my best to keep you looped in and help you feel like you have your finger on the pulse of what's going on in the AI and Tech world. So thank you again for tuning in. Thanks to Nid for sponsoring this one. I really appreciate you guys. Hopefully I'll see you in the next video. Bye-bye.

AI News: "Hollywood-Grade" AI Video Revealed!

AI, No-Code, Tech, Futurism - I'm a tech nerd and talk about tech nerd stuff

Matt Wolfe

Odyssey is a new AI tool that promises Hollywood-grade visual content generation, with a focus on glitch-free and stunning visuals, and it is developed by a team with experience in self-driving cars and the video game industry.

Live Portrait, another viral AI tool, allows users to animate still images using driving videos, and it is currently available for free on Hugging Face space, with some limitations in syncing with facial expressions.

Paints Undo is a new research project that takes finished images and provides a step-by-step guide on how to draw them, offering a reverse approach to AI art generation.

Tool for Creating Anime Art and AI-Generated Videos

The tool allows users to reverse-engineer anime art and provides instructions for recreating it on paper.

The code for the tool is available on GitHub, with a caution against deploying it to Hugging Face due to long processing times.

The tool Nid AI offers AI-generated video creation, allowing users to easily edit, swap, and translate videos, potentially saving hundreds of dollars a month in fees.

New Features in PO Chatbot and Anthropic's Tools

PO chatbot has introduced a new feature called Previews, allowing users to interact with web applications directly in the chat.

The Previews work well with coding models like CLAE 3.

5, and can be shared with others via a dedicated link.

On the other hand, Anthropic has made their artifacts shareable, enabling users to try, remix, and build on top of them, thus enhancing the capabilities of their tools.

Additionally, Anthropic has rolled out the ability to evaluate prompts inside the developer console, further improving the user experience.

OpenAI has blocked access to its models in China, sparking speculation about the imminent release of GPT-5.

Microsoft's Azure still provides access to GPT-3 in China, leading to rumors of a potential fallout between OpenAI and Microsoft.

Additionally, Microsoft is now backing out of its planned observer role on OpenAI's board, indicating a shift in their relationship.

Apple's Change of Plans and OpenAI's Innovations

Apple has decided not to take on an observer role in the new Siri feature deal, possibly due to antitrust concerns.

OpenAI is partnering with Los Alamos National Laboratory for bioscience research and collaborating with Arianna Huffington to develop a hyper-personalized AI health coach.

Stability AI has updated its license terms for Stable Diffusion 3, now allowing free commercial use for individuals and small businesses, and has released new features in Stable Assistant, including a search and replace function and text-to-audio updates.

Legal Battle Over AI Copyright and New Magnific AI Plugin

A recent court ruling suggests that AI systems can avoid copyright infringement by producing different output from the input, setting a precedent for future lawsuits.

Magnific AI has launched a new Photoshop plugin, allowing users to directly access its upscaling and image reimagining tools.

In California, bill SB 1047 is being contested, as it has the potential to impede AI researchers and developers, with Anan Madada being one of the opponents fighting against the bill.

Samsung's recent Unpacked event unveiled a range of new gadgets, all equipped with various AI features, including AI-based photo generation, suggested replies, AI-powered sleep tracking, energy scoring, and real-time language translation.

The company's Galaxy Buds 3 Pro even offer an interpreter setting for live language translation.

These AI capabilities demonstrate Samsung's commitment to integrating artificial intelligence into its products.

The Vision Model: An AI Tour Guide with Common Sense Reasoning

The vision model can navigate its environment, identify landmarks, and provide information using a combination of vision, language, and common sense reasoning.

It can respond to written, drawn, and gestured commands, functioning as an AI tour guide.

The creator of the video also shares AI news and tools on a daily basis through a newsletter and website, aiming to keep the audience updated on the latest AI and tech advancements.