Adobe announces major AI updates for Firefly and its creative apps

At its annual MAX conference, Adobe announced a wide range of new artificial intelligence features for its Creative Suite, focusing on its generative AI platform, Firefly, and flagship applications like Photoshop and Premiere Pro.

The company is expanding the capabilities of Firefly, its generative AI tool for images and video. Individual users can now train custom AI models on specific characters or artistic tones, a feature previously limited to business clients. Adobe states that its new Firefly Image 5 model generates higher-quality images and introduces layered image editing. This allows the AI to identify individual elements within a picture, enabling users to move, resize, or replace them using text prompts.

Firefly is also moving into audio generation with two new features:

  • Generate Soundtrack: This tool analyzes an uploaded video and suggests music based on user-defined prompts for vibe, style, and purpose.
  • Generate Speech: A text-to-speech function that uses Adobe and ElevenLabs models to create voiceovers in 15 languages, with options to add emotional inflection.

AI assistance is also being integrated more deeply into Adobe’s core applications. A new AI Assistant is being introduced in Photoshop and Adobe Express, functioning as a chatbot that can perform edits based on conversational commands. According to Adobe, the assistant is designed to help users learn the applications while carrying out tasks. In another update, Photoshop’s Generative Fill tool will now allow users to choose between Adobe’s Firefly model and third-party models from Google and Black Forest Labs.

For video and photo editing, Adobe unveiled new tools in public beta. Premiere Pro receives an “AI Object Mask” feature that automatically isolates people and objects in video frames, simplifying the process of applying effects. Lightroom is getting “Assisted Culling,” a tool designed to scan large photo collections and recommend the best shots to photographers.

Looking ahead, Adobe also teased “Project Moonlight,” an AI agent intended to act as a creative director for social media. The company says this assistant will connect to a user’s social accounts and Creative Cloud apps to generate content that matches their personal style and analyze audience engagement. Adobe also confirmed it is in the early stages of working with OpenAI to integrate its creative AI tools directly into ChatGPT.

Sources: Wired, The Verge, The Verge

About the author

Related posts:

Stay up-to-date:

Advertisement