런웨이 3세대: AI 비디오 생성 및 한계

### 런웨이 3세대: 종합적인 검토 및 분석
* 🚀 "런웨이 3세대"는 **"크리에이티브 파트너 프로그램"**을 통해 일부 크리에이터에게 제공되는 최신 AI 동영상 도구입니다.
* 👍 우주 장면, 화려한 만화경, 레이저 효과와 같은 **'추상적 개념'의 동영상**을 제작하는 데 탁월합니다.
* 🐺 '달을 보고 울부짖는 늑대', '롤러스케이트를 탄 원숭이', **'타코를 먹는 고양이'**와 같은 일반적인 프롬프트는 일반적으로 좋은 결과를 낳습니다.
* 🚗 특히 고속도로를 달리는 자동차나 오로라 같은 **'타임랩스 샷'**을 촬영하는 데 효과적입니다.
* ❌ 하지만 이 도구는 특히 손이나 복잡한 움직임이 있는 **'사람'이 등장하는 동영상**에서는 어려움을 겪습니다.
* 📝 동영상의 '텍스트' 생성도 '히트 또는 미스'로, 일반적으로 **'런웨이'와 같이 짧은 단어**가 더 효과적입니다.
* 🗓 공개 출시일은 아직 확정되지 않았지만, 런웨이의 과거 관행에 비추어 볼 때 **'향후 몇 주 내'에 출시될 것**으로 예상됩니다.
* 🔄 원하는 결과를 얻으려면 사용자가 **"다른 프롬프트를 시도"**하고 동영상을 여러 번 생성해야 할 수 있습니다.

런웨이의 3세대 AI 동영상 도구는 추상적인 개념에 강점을 보이고, 사람 피사체를 다루는 데 어려움을 겪으며, 개선 가능성이 있는 것으로 나타났습니다.

the latest in a stream of AI video tools is finally here for some of us to use, and it's called Gen 3 from Runway. It's actually pretty cool; some of the videos I've seen coming out of it so far are just really mesmerizing and really cool looking. This first one I showed you was from my buddy Bavo Sidu, and he showed off some really creative, really impressive videos that play with light and abstract art. Here's another one Bavo did of deers while looking through a scope; he simulated a first-person shooter. Here, I mean, the person or whatever it is he's shooting at doesn't look amazing, I mean, pretty good compared to what we had just six months ago. This other jellyfish one that I was showing you here a second ago comes from Nicholas Newbert, who actually works over at Runway, and he's kind of been going to town over on his ex account sharing all sorts of really cool generations that he's managed to get out of Runway.

this video I want to talk about runweight gen 3 put it through its motions find out if what we're seeing is actually just cherry-picked examples or if we get this kind of result every single time. Gen 3 is not publicly available yet. Runway has what they call the creative partner program, which specifically allows creators to get in on tools like this a little bit early and play around with it, test it, and offer them some feedback. Historically, once people in the creative partner program get access to it, it's usually only a week or two later that the general public gets access to it. Now I have been asking people over at Runway when can we expect to see The Wider release of this, and they basically said they can't tell me yet, they don't exactly know, but typically it's within a couple weeks after the creators get access to it. I got access to it a couple days ago, and you can see that I have generated quite a few videos with it already. These are all my gen 3.

generations. So at this point, I feel like I've got a pretty decent feel for the things that it's good at and the things that it's really still not that great at. But before we get into that, let's go ahead and do a quick generation. I will show you the real-time exact how long it takes to generate a video. For this first test here, I'm going to try a humanoid robot doing the robot dance in a nightclub with colorful flashing lights. This may or may not be the best video we've ever seen it generate, but I wanted to show you an example of how long it takes to generate. So I'm going to press this generate button. You can see I'm going to leave it set on 10 seconds here. So let's go ahead and click generate. The clock ising time goes by eyes are glued can't deny gently from way a I make my Visions come alive. Lo scens feel so slow. IM and our video is now ready. I'll put on the screen how long it took exactly.

let's take a peek at our robot doing the robot. Not too bad. I mean the hands are sort of morphing, and the people in the background are sort of morphing weirdly. Not a horrible video. They also have a pretty cool feature where you can enable desktop notifications to get notified when a video is complete. So if you enable this, you'll get a little popup letting you know when it's complete, so you can actually go do other things or watch a YouTube video or something. And then when you get that notification, you know your video is ready. So first, the things that I found it's really good at is I really love what it does when you think of more like abstract concepts. So the very first generation I ever did when I got my hands on gen 3 was a detailed first-person view flying through the colorful Cosmos. And this is the video that it generated, and I thought this video was really cool. I can see using this as b-roll if I'm talking about space or the cosmos. Here's another

more abstract concept that I plugged in colorful RGB world. I just gave it that short prompt 'cause I wanted to see how it did if I just didn't give it much details, and I let the AI figure out what to make. And this is what it generated. Again, this abstract stuff in my opinion looks really cool. This prompt was colorful RGB trippy Kaleidoscope mirror moving shot. Here's another where I just regenerated the same prompt of colorful RGB trippy Kaleidoscope mirror moving shot. And once again, another really impressive cool abstract Style video. I really like these abstract videos because I love the color palettes that Runway seems to pick. And finally, one last one, colorful lasers and particles. This is what it generated from that. To me, it kind of reminds me of like a screen saver from 15 years ago that we all thought looked cool. I then had to test my go-to prompts. So, one of my go-to prompts was a wolf howling at the moon, which once again, I think this one came out really good. The first couple seconds.

were a little weird when the wolf was looking down, but when the wolf actually looks up and you see the silhouette with the moon. The thing is these are 10-second videos, so if I was to use this for b-roll, I'd probably only use it for 5 seconds or so. So I would just cut out the first part where the wolf is sort of looking down and looks kind of funky and just start right there when the wolf starts to lift his head. Very usable for b-roll of a wolf howling at the moon. I'm impressed with that one. Another go-to that I like to use is a monkey on roller skates, and when I tested that prompt, it actually made a really good-looking monkey. I think this monkey is impressive, but uh, the roller skates, that's another issue. I'm not seeing them. Something that I think is really cool about this video is if you watch the shadow of the monkey, it's really consistent with the monkey self, like the shadow looks like it would actually be That Monkey Shadow. So I think it did a

really good job with that. I also always like to use a cat eating a taco. That was one of my prompts that I was using like two years ago when I was generating AI art, and I still always come back to this one. This looks pretty good to me as well. The tongue gets a little funky at parts, but for the most part, it's a pretty good video. And if you're using this for something like b-roll, you're probably only going to take like four of the 10 seconds. So just find that window of like the 4 seconds you're going to use for b-roll and just get rid of the rest. I find it to be really good at time-lapse type shots. Here's one of a time-lapse of cars on a freeway viewed from an overpass above the freeway. This to me looks like perfect b-roll that you can use in a video. If you ignore some of the text that's supposed to be on the roads, it looks like somebody got on the road and just sort of scribbled with some.

chalk, but other than that, I mean, the time lapse of the cars going by looks pretty good. You got the red lights from the brakes of these cars as it goes that direction. You've got the white lights from the headlights of the cars coming in this direction. To me, it's very coherent. It knew its role. Here's another time lapse. I did a time lapse of the northern lights over the Arctic snow. I wish it wasn't moving backwards like it is. I wish it was just sort of sitting still, and then the movement was more just in the night sky and not the actual camera motion, but this is still really, really impressive to me. I'm really happy with this video. Here's another one that I actually liked. A peaceful still shot on the side of a green grassy Hill in Japanese temple with water stream cherry blossom trees and cherry blossom leaves falling everywhere. Now it didn't get all of the elements of the prompt. We're not really seeing cherry blossom leaves fall, but we definitely have the Japanese Hillside. We've got the temple. We've got

the water stream, we've got the cherry blossoms. It kind of only missed the falling cherry blossoms. Everything else, it did pretty well. There's some weird issues with some morphing and some funkiness up here on the temple as the camera pans, but again, if you're going to use just a few seconds of this 10-second video, you're probably going to find a little window of this video that works well. Cinematic Fast and Furious-like shot of a nighttime rainy car race on the streets of Tokyo. This looks really good. I mean the numbers up here look pretty good. They get a little funky from time to time, but they look pretty good. Some of the cars, they kind of change shape a little bit as they get further out into the distance, but third-person view right behind this car looks really, really good. It looks like this could be a shot from a video game if you kind of ignore some of the text 'cause the text just sort of looks like gibberish, but that's a really, really cool shot, I think.

then here's another video game concept. Point of view first-person shooter video game but holding a baguette like a weapon and walking around a French bakery. This one nailed it except for one issue that you probably noticed a second ago. There's a moment where like a roll of cheese or something pops into the screen. Other than that, I mean this is a French baguette held like a gun walking around a bakery like no question what we were trying to go for for this other than that little like pop in that happens there cut that out use the rest for b-roll you got a good clip. All right so that's the stuff that I think it did really really well. The things that I found it struggled with when you have people in the shot it's very Hit or Miss usually the problem is when you can see the hands if the person's hands aren't in the shot it looks good as soon as hands move into the video the video gets wonky. So here's one a rapper on stage in

front of a massive crowd while jumping around and singing into a microphone. If you look at this, it's actually not bad. But what just happened with their hands there? Like for a second, he moved his hands around and his hands just kind of disappeared. Here's another one with the same prompt: a rapper on stage in front of a massive crowd, and once again, like his arms just kind of disappear, his hands turn into a blur, the microphone floats in front of them. It gets a little funky. I'm really impressed with the crowd. It's just looking at the rapper. Uh, not great. Here's another one: a man strapping in goggles and entering a virtual reality world. Once again, not too bad. I think this one's actually one of the more solid videos that I got with an actual human in it, but right as he's putting on the goggles, for a second, his hands are kind of funky. You can kind of see the fingers get a little funky. I would definitely use the second half of this video as b-roll and be totally happy.

with it, I also tried a beautiful woman bowling a strike in a bowling alley, and well, yeah, this is the result of that one. You know, she's just walking down the bowling alley, and it was sticking to her like nine fingers, and then she's got three arms, so you know, people are very hit and miss with this. A man with a beard shakes hands with a humanoid robot. You got the man with the beard, you got the humanoid robot, but the robot has a man's hand. Also, a samurai warrior practicing with his samurai sword. The sword kind of turns into two swords and changes lengths, so there's definitely some consistency issues with the sword. A man waves, leaves his arms around, and bubbles are generated from his hands. This one's pretty good. The man looks really, really good. Faces are really good on this one, and it's not too bad until his hands cross over and sort of merge together at the end there. A rock band plays music while under the ocean. This to me, I thought looked really cool, but

again, the microphone's just floating there. The hands are funky. His guitar has a couple guitar necks on it for some reason, so there's some weird issues with the instruments they're playing, and this weird mic with no mic stand, and then it merges into his hands, but the video actually looks kind of cool nonetheless. I also tried to do some like animated cartoony type stuff. 2D animated children's book man and woman hugging. This one's like borderline kind of creepy. It got the 2D animation, but I don't know, there's just something off about it. Children's book illustration style of Grandma rocking back and forth in her chair. Not too bad. It's not really following the prompt. I can't tell if these are her legs or the cat's legs or the cat's tail, and it doesn't really look like she's rocking in the chair either. It's just kind of zooming in on her, and she's nodding her head a little bit. Here's another attempt at a cartoony.

one 3D animated Disney flyby drone shot of Wreck-It Ralph world. I'm not seeing anything Wreck-It Ralph related in this image. I mean, maybe kind of, I guess. Wreck-It Ralph has the like race car scenes with the candy girl. I'm forgetting her name, um, and so I guess it's kind of like the race car scenes from the movies, but I don't know. It's definitely not amazing. This one's one of the funkier generations I got. I also tried to do some videos with different perspectives like drone shots. Here's one that's a drone flyby shot of complex miniature Hot Wheels track inside a bedroom while small Hot Wheel cars race. And it's got that sort of great angle on it, the sort of drone angle, but the cars are just sort of going in funky directions and doing weird things. You'll see here some of the cars just randomly disappear and these two cars just sort of merge through each other.

lot of funkiness going on in this one. I also tried to do a first-person view looking through the helmet of a quarterback in football as he throws the ball. Apparently, this is what a quarterback sees: a circular hole and then the ball just floats up in front of his face. Um, you know, that's, um, that's something. A tsunami hitting a city made out of food. I see the tsunami, I see the city, I don't see it made out of food until maybe a few minutes after the tsunami. It's almost like the food comes out of the tsunami. It's a very interesting, unique video, but it's not quite what I was looking for. And finally, I wanted to look at text 'cause I've seen a lot of really cool text inside of videos. So, proper prompter here on X showed off some really cool examples like Runway being spelled out into a forest. Runway sort of coming out of this like smoke effect. We've got runway on the beach here that sort of forms from the water. We have a movie theater scene where it

zooms in and then once it gets to the screen, we see the word Runway. And sort of like a Marvel logo, it looks really, really good. And then I saw Blain Brown here over on X do very similar stuff. It says bazan, and it's a really cool Marvel-looking logo on the streets. He showed off some other examples here. It all seems to kind of be going for that like Marvel intro look, and I thought all of these were awesome. I tried generating some stuff with text, and it seems to be very, very hit or miss with text also. So, for example, this one says, still shot of a neon sign saying subscribe to Matt wolf blinking until turned fully on in a rainy neon Tokyo City street. Now we've got the Rainy Street. It seems to only be raining in this one spot. It looks like a neon Tokyo Street, but I can't make out those words, and that definitely doesn't say subscribe to Matt wolf on it. So from what I understand, it seems to do okay at shorter words like Runway, but when you

want like a longer piece of text. Like subscribe to Wolf. Not so great. I also had a whole bunch of videos where I tried to get it to generate text, and it would just give me an error. I was actually doing them on my phone, and it looked like this. It would say generation error. Your credits will be refunded. Please try again or adjust your prompt. If you continue to encounter this error. It pretty much did this error every single time I tried to do some text inside of my prompts. Usually the longer text like subscribe to Matt Wolf. I also did a test to see if I can get celebrities in there. I tried to do the sort of famous Will Smith eating spaghetti, and it said this goes against their terms, and it wouldn't let me generate it. I tried to generate some IP like Mario and Sonic and stuff like that, same kind of thing, said it went against their terms, wouldn't let me generate those. But right now I'm still looking at text. So I attempted a pile of candy arranged to form the words Matt Wolf.

this is what I got out of it. It kind of started by saying Walt, and then blended to be Matt, and then this says wolf with two L. You can see that it wasn't totally perfect even when just trying to put two short words next to each other. But then of course, I had to try the word Runway. And when I use the word runway in my video, it looks perfect. I did a drone shot flying over the beach with the word Runway written in the sand. No problems with this at all. It looks great, looks like a beach with the words Runway written into the sand. Let's try one more real quick. A scene under the ocean with the word Mr. Eow spelled out in bubbles. And let's see what we get. Well, that one seemed to actually break Runway 'cause it got stuck at 5%, and it just won't get past that. It's actually probably been about 10 minutes since I tried to generate that one, and now it seems to have just deleted it. So it's not even there.

anymore. If I go into my generative video folder, it's not even showing up, so it just went. Now we're not going to make that one and then just disappeared. One more time, I'm going to generate, see if it works a second time. Only thing I did different this time was I capitalized Mr. eow. I think I worded it slightly different. This one's doing the same thing. It got all the way to like 98%, jumped all the way back to 5%, and then just froze. One last Quick tip. I came across this one on X from smokea away here. He suggests using chat GPT or Claud to help generate the prompts you want. Here's the prompt that he suggested: please respond with detailed and creative descriptions for text to video prompts. Provide a title in plain text followed by a scene description and camera movement, and keep the responses focused and imaginative under 500 characters of text. Then just tell it what video you want to see or have it recommend videos. So let's try this once.

and see what happens. I copy that, pop on over to Claud. I'll paste this one in, and I'll add, I want a video about a swimming robot. Let's go ahead and copy this new one here, pop it in here, and click generate. You can see that the last one, the Mr. eflow one, still stuck, still hasn't generated for me. And here's what we got out of the one that Claude just generated for us. Let's take a peek here, and that's looking pretty good. It's a little underwater robot. I mean, the propellers on either side don't really seem to be working. They look like they're flapping more like fins than anything. But you know, it's an interesting looking video. Would I say this is any better than something we might get out of like Luma or Pika? Not by much, but it's still pretty cool looking. I really like the color palettes that Gen 3 does. And as you can see, my other one that I was trying earlier, generation error. So that's Runway Gen 3.

so if you're scrolling X or Twitter, whatever, lately, and you're seeing all of these amazing Generations that people are coming up with coming out of gen 3, and you're wondering, is this stuff that they're showing off Cherry-Picked? The answer is honestly probably. They are giving you the best that they've managed to generate, but that's kind of the state of AI video generators right now. You're likely going to need to prompt something several times until you get the exact video that you were hoping to get and try different prompts and just see what you get out of it. A lot of AI art, a lot of AI video, a lot of AI music pretty much across the entire artistic Spectrum are mostly cherry-picked examples of people showing you the best work they've managed to get out of this stuff, but trust me, gen 3 still has a lot of little issues that need to be worked through. Just remember this is what AI was generating for us this time last year. This is a 2cond video of a monkey on.

roller skates with a Shutterstock Watermark across it. Compare that to this 10-second video. Yes, the roller skates are kind of missing, but I would say we've come a long way. Still, there you have it. It's not publicly available yet, but if I had to guess, it will become publicly available within the next few weeks. That's usually how Runway operates. Give it to creators first, let them test it, let them find some flaws, give some feedback, and then they roll it out more widely. We're really close to everybody being able to use this, so hopefully you enjoyed this video. I'm having a blast playing with all these AI tools lately. We've been getting a wave of really cool stuff between Runway and Luma and Sunno and Udio and Web Sim, which is another tool I'm going to talk about in the next video I'm going to release. So much cool stuff coming out right now, and really, really excited to share all these toys that I've been playing with and help you understand what they're capable of. So if

you like seeing fun, cool AI tools and how they can be used like this video. And subscribe to this channel. I'll make sure more of these keep showing up in your YouTube feed. And if you haven't already, check out futur tools. If you love AI tools and news, you're going to love that site. Thanks again for tuning in, really appreciate you. See you in the next one. Bye-bye.

Runway Gen-3: Game-Changer or Overhyped?

AI, No-Code, Tech, Futurism - I'm a tech nerd and talk about tech nerd stuff

Matt Wolfe

런웨이 3세대 AI 동영상 도구의 영향력

런웨이 3세대는 현재 크리에이티브 파트너 프로그램을 통해 일부에게만 제공되며, 공개 날짜는 확정되지 않았습니다.

사용자들은 매혹적이고 인상적인 동영상을 제작할 수 있으며, 특히 추상적인 콘셉트에서 뛰어난 능력을 발휘합니다.

이 도구는 우주 및 우주와 관련된 동영상을 제작하는 데 강점이 있지만, 사실적인 이미지와 정확한 디테일을 구현하는 데는 여전히 어려움을 겪고 있습니다.

다채로운 추상 동영상 및 동물 프롬프트

런웨이 AI는 생생한 색상 팔레트와 환상적인 만화경 효과로 인상적인 컬러풀한 추상 동영상을 생성합니다.

또한 달을 보고 울부짖는 늑대, 원숭이, 타코를 먹는 고양이 등 사실적이고 활용 가능한 동물과 풍경의 짧은 클립을 생성합니다.

생성된 동영상은 약간의 불완전함에도 불구하고 B-롤 및 타임랩스 촬영에 적합합니다.

이 동영상은 도쿄의 야간 자동차 경주와 프랑스 베이커리에서 1인칭 슈팅 게임을 촬영하는 데 탁월합니다.

하지만 사람의 손이 개입되면 시각적 왜곡이 발생하여 일관성을 유지하는 데 어려움을 겪습니다.

볼링 선수, 사무라이 전사, 거품을 만드는 남자가 등장하는 동영상에서는 시각적 불일치와 변형이 심각하게 나타납니다.

일관되지 않고 비정상적인 시각적 창작물

이 영상에는 2D 애니메이션 포옹, 흔들 의자에 앉은 할머니, 3D 애니메이션 주먹왕 랄프 세계 등 다양한 시각적 창작물이 등장하며, 그중 일부는 독특하거나 기발한 요소를 담고 있습니다.

드론으로 촬영한 핫휠 트랙, 쿼터백의 1인칭 시점 등 다양한 시점을 시도한 결과 시각적으로 펑키하고 특이한 결과물이 탄생했습니다.

다른 크리에이터의 사례에서 영감을 받아 동영상에 텍스트를 사용한 결과, Marvel과 같은 로고를 만드는 데는 성공했지만 생성된 장면에서 특정 단어를 표시하는 데 어려움을 겪는 등 엇갈린 결과를 보였습니다.

텍스트 생성 및 비디오 프롬프트 관련 문제

사용자가 텍스트 프롬프트를 생성하려고 할 때 유명인 이름 및 특정 문구 사용 문제를 포함하여 여러 가지 오류가 발생했습니다.

또한 시각적 프롬프트를 생성하려고 시도할 때 일부 프롬프트는 오류가 발생하고 다른 프롬프트는 기대에 미치지 못하는 등 어려움을 겪었습니다.

잠재적인 해결책으로 ChatGPT 또는 Claude를 사용하여 프롬프트를 생성하라는 권장 사항이 제공되었습니다.

그러나 프롬프트 중 하나가 5% 생성에 머물러 있어 사용자는 여전히 어려움을 겪었습니다.

비디오, 음악, 미술을 포함한 AI 예술 생성기는 종종 최고의 작품 중 엄선된 사례를 선보입니다.

인상적인 발전에도 불구하고 AI 제너레이션에는 아직 해결되지 않은 많은 문제가 남아 있습니다.

이러한 도구는 앞으로 몇 주 안에 공개될 예정이며, 더 많은 사람들이 그 기능을 탐색하고 즐길 수 있게 될 것입니다.