Adobe Firefly’s Newest Feature Will Be AI Video Generation [CNET]

The new text-to-video capabilities in Firefly can create new footage and extend existing clips.

Adobe is expanding its AI model Firefly to include video generation capabilities, the company announced Wednesday. Previously, Firefly offered image generation and editing tools integrated throughout Adobe’s Creative Cloud suite of programs. 

Adobe teased the new feature in a video where we can see someone inserting a lengthy prompt in a query box to create different kinds of videos. We also see a sidebar menu that lets you adjust the motion of a shot and insert a reference image in your prompt. It also showed how you can use it to create new footage to extend existing clips and fill in potential gaps.

This video is all we have for now, as the feature won’t be available with Firefly until later this year. You can join the waitlist here, but be sure to use the email that’s associated with your Adobe account.

Read More: Why Procreate’s Anti-AI Pledge Is Resonating With Its Creators

Earlier this summer, Adobe upgraded its AI tools in Photoshop and Illustrator, introducing an AI image generator in Photoshop and a generative shape-fill tool in Illustrator. Firefly’s current privacy policy states that it does not train its models on Creative Cloud subscribers’ personal content; Adobe says its models are trained on licensed databases like Adobe Stock (excluding editorial content) and public domain images with expired copyright. 

Adobe’s foray into generative AI has certainly had its bumps in the road. Adobe users were angered over a vague update to its terms of service that had them concerned the company could scan and read their content. Adobe later clarified that it can only do its content moderation on files stored on the Cloud, not users’ devices. It cited generative AI’s ability to be used to create illegal content as part of the motivation behind the changes. Adobe is also facing a lawsuit from the US Department of Justice that alleges its cancellation process is convoluted with hidden cancellation fees.