Adobe has announced the development of Firefly AI video generation tools, which are set to arrive in beta later this year. The new tools aim to simplify post-production tasks and automate much of the creative work that editors are paid for today.
The first tool, Generative Extend, will be available in Premiere Pro and enables editors to create AI-generated videos from text prompts, as well as fill gaps in footage, remove unwanted objects, smooth out jump cut transitions, and search for b-roll. Adobe claims this technology will give video editors more time to focus on creative ideas.
The second tool, Firefly Text-to-Video, allows users to generate videos from text prompts and also includes tools to control camera angle, motion, and zoom. It can fill gaps in footage and even turn still reference images into convincing AI-generated videos.
Adobe has showcased the capabilities of these tools through promotional videos, which demonstrate impressive results. For example, a text prompt for an establishing shot of a fiery volcano produces exactly that. Similarly, an uploaded galaxy image is transformed into a video that zooms out to reveal the inside of a human eye.
While the technology appears promising, some critics have raised concerns about the potential impact on jobs in the industry. Adobe has stressed that its tools are designed to be commercially safe and only train on content it has permission to use, but the long-term effects remain unclear.
The Firefly Video Model will initially generate five-second clips, with plans to expand capabilities in the future. Users can sign up for a waitlist to try out the new technology when it becomes available later this year.
Source: https://www.engadget.com/ai/adobe-previews-ai-video-tools-that-arrive-later-this-year-172021715.html