In March, Adobe announced Firefly software, a new generation of generative AI that will be used in Photoshop, After Effects and Premiere Pro to create fonts and images. On Monday, the company announced that it will add video and audio synthesis to apps and features.
Course
Team management in business
In a demo of Firefly for Video published on the Adobe blog, the tool generates a background soundtrack, sound effects, changes the visual background to the video, and more. Among other things, the new AI functions allow you to improve the color of the footage, create animated text and logo using simple text prompts.
Media editor Runway announced similar features back in September, although it did not fulfill the promises presented in the teaser. Adobe’s announcements can also be treated with a grain of salt until the end user receives the product.
Last week, Adobe also announced the launch of a video editing feature with transcripts in Adobe Premiere Pro as early as May, which will allow you to trim and reorder videos based on automatically detected speech transcripts obtained from clips. Here’s how Adobe describes the feature:
“Text-based editing automatically analyzes and transcribes clips so that editors, producers and assistants can simply copy and paste suggestions in any order and instantly see them on the timeline. The transcript can be viewed in the transcript window to identify the exact words and phrases.”
Adobe says the AI video editing software will begin rolling out “later this year” – at which point users will be able to try out Firefly’s other features (creating fonts, images, audio and 3D models) by signing up first. Currently, the project is at the stage of closed beta testing.
The company notes that such tools will be particularly useful in the film industry. This year, Adobe programs helped bring 10 Oscar-nominated films to life, including the Best Editing and Best Picture winners for Everything, Everywhere and At Once.