AI startup Runway has launched its first mobile app on iOS, letting people use the company’s video-to-video generative AI model — Gen-1 — directly from their phones. You canGen-1 allows you to transform an existing video based on a text, image, or video input. Functionally, it works a lot like a style transfer tool . You can upload a video of someone cycling in the park, for example, and apply an aesthetic or theme.
Of course, because this is a generative AI, the output is often... strange. If you add a claymation effect, for example, your resulting models won’t function likeclaymation. The models will warp between each frame; limbs will grow and shrink; features will melt and smear. That’s all to be expected, though, and doesn’t take away from the fun.. Most notable to me is the clip in the bottom right, which uses a picture I’d taken of a cat as an intermediary.
Here’s another example: a video of St. Paul’s Cathedral in London with the “paper and ink” filter applied. It’s not a mind-blowing effect, but it was incredibly easy to make. And in the hands of a more experienced and creative individual, I’m sure it could be spectacular. I’ve been testing Runway’s app for a few days now, and it certainly makes the whole process of creating this sort of video much more fluid. It’s not a seamless experience, of course. There are the usual inefficiencies and unexpected errors you’d expect to find in the first release of an app.
There are other limitations worth mentioning. You can’t work with footage longer than five seconds, and there are certain banned prompts. You can’t generate nudity, for example, and it seems copyright-protected work is off-limits, too. My prompt to create a video “in the style of a Studio Ghibli film” was rejected. Each video also takes around two to three minutes to create, which doesn’t sound like a lot but feels like an age in the era of instant mobile editing.
Technology Technology Latest News, Technology Technology Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Source: WOKVNews - 🏆 247. / 63 Read more »
Source: ABC - 🏆 471. / 51 Read more »
Source: ksatnews - 🏆 442. / 53 Read more »