(curious electronic music) - All right, let's play a game real quick. Is this next video real or AI-generated? (timer ticking) Go ahead, take your time. (timer dings) So, that was a real video. That was a video from a YouTube channel.

Now, what about this video?
Real or AI-generated? (soft electronic music) Okay, that one's AI-generated. Not a lot of giveaways, unless you happen to have memorized the geographical landscape around Mount Fuji and hunted for inconsistencies.

But, okay, what about this one? And, yeah, you guessed it already. This one's AI-generated too. Okay, what about this one? Pay really close attention. Did you catch it? See, no, okay, that one was real,

but the fact that you thought about it... So, for the last week, I have had full access to the newest and most advanced version of Sora, which is the AI video generation tool from OpenAI. And the results that I've gotten from it

are both horrifying and inspiring at the same time. The last time I looked at this, nine months ago, this was a very private tool that was just unveiled. They were just starting to show its capabilities, and so we were looking at other people's prompts.

Actually, basically, it was OpenAI's carefully hand-selected prompts for what they wanted to show us, and we could learn some stuff from that. But this time I just get the controls myself. It's just an open text box.

My wish is Sora's command, and that's actually kind of a lot of pressure. You can type whatever you want, but I did not take this responsibility lightly. I basically, over the past couple of days, have been taking every possible angle

of asking Sora to make things for me. I've asked for photorealistic things. I've asked for cartoon things. I've asked for objects, people, signs, actions, text, still life, everything you can imagine. And I feel like I've come away with a pretty good sense

of what it's good at, what it's bad at, and what it could actually be used for today. But this is a powerful tool that's about to be in the hands of millions of people. So consider this the first ever Sora review:

the good, the bad, and the ugly. Let's jump in. So, first of all, this is the UI. On the left side, you can explore other prompts that people have recently made, and then some featured ones where I suppose OpenAI is still going to curate

some of the best results to showcase what it can do. And if you hit the bookmark button on any of these, they'll show up in your saved tab. And what I like about these, again, is that anything you click on,

you can see, obviously, who made it, but you can also read exactly what they typed into the prompt box to get this result. And I'll get back to that in a second. So, then, underneath that, you have your library

Of all the videos I've generated from Sora prompts, anything I've tagged as a favorite from my own creations, and then uploads, which are any of the files that I've uploaded to Sora for it to make videos out of,

another crazy feature that I'll get to in a second. But then, lastly, you have your folders, so you can organize things that you've created into different folders, maybe for different projects or different themes, or whatever, just to keep things somewhat organized.

So, okay, right off the bat, Sora is a tool after all, and so this feature of being able to see what other people are typing and then the results they create from those prompts is both for inspiration but also for education,

because it is really interesting reading how simple or how detailed some of these prompts are and then looking at what Sora generated and what creative liberties it took to add on its own. And then, if you really like someone else's results

but want to adjust it in just a slight way for your own use, there's the remix feature. So you hit that button, and then you can describe specific changes you want it to make to that video for it to then generate a new one.

So, for this one, for example, I like this shot, and the house is pretty cool, but I kind of want there to be a golf course on those cliffs in the background. So I type that, and then I can also change the resolution,

Which, as you can see, takes longer for higher resolutions. You can also specify the remix strength: subtle, mild, or strong, dictating how much it changes the results from the original.  You can even dial this in on a slider from one to eight.

I think adding a golf course would be nice, but I want to keep the cliffs and the house, so it's a mild change.

Click "remix", wait a bit, and boom! You have a fresh, new, artificially generated video with the same house and cliffs, but now in 1080p and with a golf course in the background.

Wild! I've found that 360p videos take very little time to generate. I don't want to use the word "create" here.  These are artificially generated from source material, but basically, a five-second 360p video

will generally take less than 20 seconds to generate. They're generated on OpenAI servers, so it has nothing to do with my computer's speed or my internet connection. Once I send off the prompt,

it just takes that time, and then when it's done, it shows up, and I can download it. A 1080p, 10-second video looks significantly better, but it also takes much longer.

It can take a couple of minutes for a really detailed prompt and a 1080p video. And that's also right now, when almost no one else is using it. I kind of wonder how much longer it'll take when this is just open for anyone to use.

But that's roughly how long they've taken. And there's also the storyboard feature, which kind of looks and acts like an online video editor where you can string together several prompts. And it works best for stringing together several different actions in a row.

Basically, I've noticed it's hard to get a video to do several different things in succession with a single prompt, but you can use their built-in editor to string several prompts together in a row, and then storyboard can help you blend them all together

into one longer video, and that actually can work better instead. So I've been playing with this all week, and I've been throwing dozens and dozens of prompts at it with all sorts of characters, different styles, different unique things in the video.

And so here are some observations that may surprise you, or maybe not. So, one, it seems like there is no object permanence. So, we had AI-generated images, right? And they've gotten... You've seen the arc of them getting better and better

and higher resolution and more realistic over time. Now that we're doing videos, basically they're stringing together a bunch of different AI-generated images in a row with some sort of continuity. But for a video to make sense to a human,

The objects kind of have to move in certain ways and behave in certain ways in the real world. And so, one of the most common dead giveaways of a flaw in an AI-generated video, especially with this tool, is errors in object permanence.

So you'll see things like objects passing in front of or behind each other in ways that don't make sense. You'll see stuff disappear or reappear out of thin air, especially if objects pass in front of them,

but even sometimes without any real reason at all. They can also just materialize and then vanish, like the smartphone in this imaginary tech reviewer's hands. Boop, just gone. And there's also another one that's really common.

Anytime something with legs has to walk, if you just watch the legs for long enough, they almost guaranteed will mess up which leg is the front leg and which is the back leg. Just look at this one. Just try to watch one of the legs,

and you'll see it happen. It switches back and forth from the front leg to the back leg. This is super common. It happens all the time in these. And that brings me to another one of my biggest observations, which is that it just struggles with physics in general,

the way things move, which actually makes perfect sense, because physics would seem to require some understanding of what you're making a video about. So, in the same way that large language models can struggle with hallucinations or putting together sentences that are technically incorrect,

or don't quite make sense, these video models will also struggle with putting together videos where the movement of the objects, since it doesn't know that they're objects, sometimes also doesn't really make sense. Pretty much anytime I try anything remotely photorealistic,

basically, you instantly notice that the movements don't look right. It tends to look kind of slow-motiony, actually, but then other parts won't be in slow motion, which our eyes pick up on right away. I was playing with making CCTV-style footage,

'cause in my head, that's going to be the easiest thing to fake. People are going to get their hands on this; they're going to fake security camera footage all the time. But even in this, you can see the movement of the humans is just slightly off.

First it's a little slow, then it's fast for no reason. It's just weird. Now, it seems to be decent sometimes at fluid dynamics, for whatever reason. I've been very impressed with some examples of water rippling or crashing in waves,

or moving in realistic waves. It does happen sometimes. It can be actually pretty good-looking. And the same thing also with fire. Sometimes it can look pretty realistic, even if the smoke isn't. But, yeah, physics in general is definitely a weakness.

So then, if you know this, you can mess more with claymation or cartoon styles, and then those irregularities and movement or physics become a lot easier to palate, because it feels more like a stylistic choice.

or an artistic choice. But I'll get to the stuff that it actually does really well in a second. But there is another feature that you might have seen around the internet a little bit with some other tools like this that takes a source image

and can turn it into a video with a prompt. So, people have been bringing memes to life and imagining what would happen right after some iconic image, just by typing into the AI video generator and asking Sora what it would look like,

and Sora can do that too. The difference with Sora, I've found, is it's way less likely to try anything that it recognizes as having any copyrighted or intellectual property whatsoever. It's pretty picky. It actually does reject a lot of stuff.

Anything with any public figures or recognizable characters in general, or logos, it actually refuses to do it. It will also refuse if it thinks any subject you upload in the image is under 18 years old. Makes sense. But I did upload this AI-generated image,

which Dolly made, and asked it to make them all singing and dancing, and hit "generate", and it totally did it. Again, it helps a lot that they are cartoon-styled and not some super realistic scene, but this is a totally AI-generated video.

I also tried a few other images from my camera roll, and these just... it just gets weird. It just doesn't know the context of what direction any object was moving in the photo. Again, it doesn't know physics, and so things just get really wonky.

It's impressive that it's an AI-generated video, but you can tell pretty quickly that it is AI-generated. So, all that being said, we've seen what it's good at, we've seen what it's not so good at,

and you might be wondering, what is this tool actually for? And I actually found a few things that aren't so scary that are actually pretty good. So, these are the things that I found, as of right now, that Sora can be used for.

Abstracts. So, you can be as descriptive as you want and create all sorts of textures and colors and gradients to make an abstract shape move around in a way that essentially looks like it could be a screensaver or just some background piece or whatever you want.

I'm sure there's a world where someone's going to make an NFT out of this stuff. Also totally weird. But you can do abstract stuff for sure. I noticed it's getting better at reproducing text, especially when you ask it for specific text.

So, there is sometimes background garbled text in these videos, and that's going to continue to happen, but I've found that if I ask it for an individual title slide in a style, it actually could give me the correct text on that slide.

This animation it gave me of sketching the Empire State Building; this would make a killer title slide or even an intro to a documentary about the building, or Manhattan, or something like that. I was very impressed. And then stop motion or cartoon-style characters.

Again, like I said before, cartoons don't necessarily have to have realistic movements or physics, so the errors in those things don't hit the eye as much, and so the characters still look like, dare I say, art.

They're characters. Especially in scenes like this one. The graffiti doesn't have to actually say real words for this to look normal. The bear doesn't have to have the correct number of fingers or toes. It just looks like some album art come to life, basically.

which I'm sure someone would find useful on social media somewhere. And while we're at it, here are a couple of other random prompts that impressed me. I asked for Santa fighting Frosty the Snowman in the style of "Mortal Kombat",

and it built a readable scoreboard. I didn't ask for the scoreboard, but it built all that, with the names and everything, which is pretty crazy. Immediately, again, the details are weird when you start looking at it, but this could be a good inspirational starting point.

And then I also asked for a video of a tech reviewer sitting at a desk, and I said nothing about this fake plant, but Sora took the liberty of adding this exact fake plant here, which I said nothing about in my prompt.

And that is a convenient reminder of the other side of the tools like this, the unknowns behind many of these tools. Clearly, we already know that these are AI-generated videos that have to come from some source material. Are my videos in that source material?

Is this exact plant part of the source material? Is it just a coincidence? I don't know. OpenAI has talked about using publicly available media and data, and it's always seemed to me like a sketchy definition.

We don't know if it's everything. We don't know if it's too late to opt out, if we even wanted to opt out. And also, I have no idea how much energy this uses or if it is significantly more than the LLMs or Dolly we're using.

But still, the craziest part of all of this is the fact that this tool, Sora, is going to be available to the public, I guess around the time of this video's publication, to everyone, to millions of people all at once.

And I mean, yes, it does a pretty good job with guardrails, refusing to do anything photorealistic, refusing to use actual people's likenesses or depict any dangerous or harmful acts. And, yes, it does watermark every single generated video

with this little animation here in the corner. But you can still crop watermarks. And it's still an extremely powerful tool that directly moves us further into the era of not being able to believe anything you see online. I mean, read through the comments on my last video

about AI-generated video. This is a lot for humanity to digest right now. All of that, and these videos don't even have audio. They're only a few seconds long. They're just 1080p. This is the new baseline.

This is, once again, the worst they will be, as they continue to get better in the future. It's a lot to think about. Thanks for watching. Catch you in the next one. Peace. (light percussion music)

Real quick, thanks to Ridge for sponsoring this portion of the video and for supporting the channel. Just as a PSA, we're coming up on that time of year where we should rush to get good holiday gifts.

We're kind of running out of time. Luckily, Ridge is running a holiday sale right now with up to 40% off. And you guys know one of the reasons I partner with them is because they have actually high-quality gear.

So that's one of the things I'm going to be doing this year: getting gifts from Ridge for people. And I think I haven't gotten Andrew his gift yet, so hopefully he doesn't watch this part of the video,

but I think I'm going to get him, since he's a hiker, one of the Ridge knives. But don't tell him. But whatever you end up getting, if you go to ridge.com/mkbhd, that's where you'll be able to find

everything that's on sale and everything Ridge offers. So, shout out to them again, and catch you guys in the next video. Peace.

This Video is AI Generated! SORA Review

Marques Brownlee

이 동영상은 시청자가 실제 동영상과 AI가 생성한 동영상을 구별하는 능력을 테스트하는 퀴즈로 시작됩니다.

발표자는 어떤 영상이 실제이고 어떤 영상이 AI가 생성한 것인지 밝히며 AI가 생성한 콘텐츠를 식별하기 어렵다는 점을 강조합니다.

실제 동영상과 AI가 생성한 동영상의 추가 예시를 통해 AI 동영상 생성의 정교함이 점점 더 높아지고 있음을 강조합니다.

발표자가 OpenAI의 AI 동영상 생성 도구인 Sora를 소개하고 일주일 동안 사용해 본 내용을 설명합니다.

발표자는 과거의 제한적인 소라 접속과 현재의 무제한 접속을 비교하며 이러한 변화의 중요성을 강조합니다.

Sora의 사용자 인터페이스 및 기능

다른 프롬프트, 추천 동영상 및 저장된 탭 탐색을 포함한 사용자 인터페이스(UI)에 대한 설명입니다.

사용자가 생성한 동영상과 업로드한 파일을 정리할 수 있는 라이브러리 기능에 대한 설명입니다.

만든 동영상을 정리할 수 있는 폴더 기능에 대해 자세히 알아보세요.

다른 사용자의 프롬프트와 결과를 보는 것의 교육적 가치에 대해 토론합니다.

리믹스 기능을 도입하여 사용자가 특정 지침에 따라 기존 동영상을 수정할 수 있습니다.

해상도에 따른 동영상 생성 시간에 대한 정보입니다.

여러 프롬프트를 조합하여 긴 동영상을 만드는 스토리보드 기능에 대한 설명입니다.

오브젝트가 사라지거나 다시 나타나거나 비현실적으로 움직일 수 있는 AI 생성 동영상에서 오브젝트 영속성 문제에 대해 논의합니다.

걷는 애니메이션을 묘사할 때 다리의 위치가 잘못 전환되는 등 오류가 자주 발생하는 것을 관찰했습니다.

특히 포토리얼한 영상에서 부자연스러운 움직임으로 이어지는 소라의 물리학적인 어려움을 분석했습니다.

소라는 때때로 유체 역학(물, 불)을 잘 수행하지만 일반적인 물리학에서는 여전히 어려움을 겪는다는 점에 유의하세요.

물리 오류의 영향을 완화하기 위해 클레이메이션 또는 만화 스타일을 사용할 것을 제안합니다.

Sora의 이미지-동영상 변환 기능 및 제한 사항

소스 이미지를 동영상으로 변환하는 Sora의 기능에 대한 설명입니다.

AI가 생성한 이미지로 동영상을 성공적으로 생성한 예시입니다.

실제 사진을 소스 자료로 사용할 때 직면하는 어려움.

추상 애니메이션을 제작할 때 Sora를 사용하는 것이 좋습니다.

특히 제목 슬라이드에서 가독성 있는 텍스트를 생성하는 데 있어 Sora가 개선되고 있음을 관찰했습니다.

스톱 모션 또는 만화 스타일의 애니메이션에 Sora를 사용하는 것이 좋습니다.

Sora를 사용하여 물리 오류가 덜 눈에 띄는 스타일라이즈드 씬을 제작한 예시입니다.

산타와 프로스티의 '모탈 컴뱃' 스타일의 싸움처럼 창의적인 프롬프트가 인상적인 결과물을 만들어낸 사례도 있습니다.

소라가 사용한 소스 자료와 개인 동영상이 포함될 가능성에 대한 우려.

소라의 에너지 소비 및 환경 영향에 대한 불확실성.

소라의 공개 석방과 온라인 콘텐츠의 신뢰성에 미칠 수 있는 잠재적 영향에 대해 논의합니다.

워터마크에 대한 언급 및 자르기 가능성에 대해 설명합니다.

점점 더 정교해지는 AI 동영상 생성 기술의 의미에 대한 마무리 발언입니다.