Hello everyone, are you having a pleasant day today?
Today, I want to show you how to create a new kind of short Awesome AI videos using Runway.
Runway
Runway AI has been showing impressive results in AI-generated animation, leading the market in this field. After developing gen1, which transforms a 4-second video into a different one, Runway developed Gen2, which can convert text to video or transform images into videos.
Today, I’m going to briefly explore how to use gen2, the amazing results you can achieve with it, and where you can use these AI-generated images.
1. Sign Up to Runway
–> Go to Website : https://runwayml.com/
First, go to the Runway website through the link below and sign up.
Like other AI platforms I’ve mentioned before, Runway also operates on a credit system, where credits are consumed to use features.
(Seems to be the trend these days…)
Like other platforms, Runway offers various subscription plans, but we plan to use the credits received upon signing up to test the features for free.
Once you sign up, you will see the Runway homepage as shown below. Its layout is somewhat similar to Leonardo.AI, right?
There are so many features that it’s hard to explain them all at once, so I plan to post them sequentially to guide you.
Today, I’ll explain about Gen2, so please click on the thumbnail labeled Gen2 under the Popular AI Magic Tools category on the home page!
You can click on the thumbnail titled “Text/Image to Video“.
2. How to use Gen2
Once you click on the Gen2 thumbnail, a familiar window for running Gen2 will appear.
This is where you can apply Txt2Vid / Img2Vid / Img2Vid(Prompt)!
The UI is so user-friendly that just by reading the text, you get the gist, right?
- TEXT
- IMAGE
- IMAGE + DESCRIPTION
Let me explain each one.
1) TEXT
This is where you create a video using only text without any reference images. Write the text you want, including the subject and a brief description of the situation. For first-timers, feel free to follow the way I do it!
I wrote the phrase “A chubby cat is dancing on the road” and then I’m going to set one option using the settings below.
Starting from the left:
- Filter: An icon to choose Seed and Upscale
- General Motion: The intensity of the motion
- Camera Motion: The direction of camera movement in the created video
- Motion Brush: A brush to designate motion (used when you want to turn an image into a video)
- Add Style: Specifies the style of the created video
The small buttons directly below the text input box greatly assist in determining the direction of the video you want to create. Although there’s no right or wrong, I recommend adjusting a bit if you have a specific idea in mind.
I’ll leave the rest of the settings as they are and select 3D Cartoon in Add Style to create.
As shown in the image, when you click the Generate button, a message will appear indicating that the video is being created, along with a loading bar showing the progress.
Oh no…!! For some reason, a flag warning has appeared. Hmmmm…, perhaps it’s because of the word ‘Chubby’? Or maybe the concept of an animal dancing? I’m not sure what the issue is, but fortunately, they say the consumed credits will be refunded! Let’s change it to “a cat is running on the road” and try again.
I didn’t expect the video to be automatically generated to this extent, but it’s really incredible! In fact, I think the prompt I wrote was too simple, making it a bit difficult to fully express the scene. However, the fact that such a video can be automatically created with just a few simple words is truly astonishing.
2) IMAGE
This time, let’s try using the IMAGE function! After clicking on the IMAGE tab, please upload any image you want to animate!
I’m going to test with a poster of a character named Mauga from Overwatch, a game I’m currently obsessed with!
Just like in the image above, upload the image file and click on the Motion Brush section, as I explained earlier.
As shown on the right, the number of brushes displayed indicates how many brushes are available for use. You can designate the direction of motion for each area of the image by coloring it with each brush.
Wow!! Isn’t it amazing?? The poster, which was just a drawing, now seems to come to life with movement! I always feel this way, but I am constantly amazed by AI technology. Although it’s just a short 4-second video, it makes me think that we could eventually even make movies with this technology.
3) IMAGE + DESCRIPTION
Now, let’s use the function that combines IMAGE and text to create a video.
This time, I want to test with a famous scene from one of my favorite movies, “My Neighbor Totoro”.
As shown in the image above, upload the desired image on the left, and then write the text just as we did initially to reflect the content you want.
Similarly, I’ll try to give as much movement as possible using the various brushes in the Motion Brush.
Let’s wait and see how it turns out.
I’m really curious to see how it will be expressed, but the fact that just one image can give a feel of animation is so exciting and enjoyable! 😆
It seems that due to the simplicity of the text I wrote, only a slight animation was reflected.
But, can you see how the parts selected with the brush clearly show the animation? I believe even this much is enough to create wonderful results.
Today, we explored the Gen2 feature of Runway. How did you find it? It seems like a fantastic platform, especially because it offers free usage options as well. I encourage everyone to sign up now and try making your own amazing 4-second videos!
If you are also curious about leonardo.ai, you can check it out through the link below.
–> Go to Post (what-is-leonardo-ai-and-how-to-use-part-1)
Next time, I’ll bring content that can be used in real situations, so stay tuned!
We’re a group of volunteers and starting a brand new scheme in our community. Your website offered us with helpful information to paintings on. You’ve performed a formidable job and our whole neighborhood can be grateful to you.
Hey there! Do you use Twitter? I’d like to follow you if that would be ok. I’m definitely enjoying your blog and look forward to new updates.
Great post. I am facing a couple of these problems.
Hello. fantastic job. I did not expect this. This is a fantastic story. Thanks!