Create generative AI video-to-video right from your phone with Runway’s iOS app

  • 📰 verge
  • ⏱ Reading Time:
  • 76 sec. here
  • 3 min. at publisher
  • 📊 Quality Score:
  • News: 34%
  • Publisher: 67%

Technology Technology Headlines News

Technology Technology Latest News,Technology Technology Headlines

A mobile app from the “optical toy” phase of generative AI.

AI startup Runway has launched its first mobile app on iOS, letting people use the company’s video-to-video generative AI model — Gen-1 — directly from their phones. You canGen-1 allows you to transform an existing video based on a text, image, or video input. Functionally, it works a lot like a style transfer tool . You can upload a video of someone cycling in the park, for example, and apply an aesthetic or theme.

Of course, because this is a generative AI, the output is often... strange. If you add a claymation effect, for example, your resulting models won’t function likeclaymation. The models will warp between each frame; limbs will grow and shrink; features will melt and smear. That’s all to be expected, though, and doesn’t take away from the fun.. Most notable to me is the clip in the bottom right, which uses a picture I’d taken of a cat as an intermediary.

Here’s another example: a video of St. Paul’s Cathedral in London with the “paper and ink” filter applied. It’s not a mind-blowing effect, but it was incredibly easy to make. And in the hands of a more experienced and creative individual, I’m sure it could be spectacular. I’ve been testing Runway’s app for a few days now, and it certainly makes the whole process of creating this sort of video much more fluid. It’s not a seamless experience, of course. There are the usual inefficiencies and unexpected errors you’d expect to find in the first release of an app.

There are other limitations worth mentioning. You can’t work with footage longer than five seconds, and there are certain banned prompts. You can’t generate nudity, for example, and it seems copyright-protected work is off-limits, too. My prompt to create a video “in the style of a Studio Ghibli film” was rejected. Each video also takes around two to three minutes to create, which doesn’t sound like a lot but feels like an age in the era of instant mobile editing.

 

Thank you for your comment. Your comment will be published after being reviewed.
Please try again later.
We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

 /  🏆 94. in TECHNOLOGY

Technology Technology Latest News, Technology Technology Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

National push to bolster security of key election technologyAn effort to create a national testing program for technology central to U
Source: WOKVNews - 🏆 247. / 63 Read more »

National push to bolster security of key election technologyThe program aims to strengthen the security of equipment that has been targeted by foreign governments and provided fertile ground for conspiracy theories.
Source: ABC - 🏆 471. / 51 Read more »

National push to bolster security of key election technologyAn effort to create a national testing program for technology central to U.
Source: ksatnews - 🏆 442. / 53 Read more »