Suno adds image and video generation with Visuals

Suno has introduced Visuals, a tool for generating images and short videos to accompany music. Users can create clips from songs in their Suno library, with an option to synchronize a character’s lip movements to the vocals.

The feature is available on the web and in Suno’s iOS and Android apps. It expands the company’s platform beyond music and spoken audio, following the launch of its Speech feature in October.

Visuals can produce clips of up to 15 seconds from a selected section of a song. Users can also generate images for uses such as album art and thumbnails. Suno says its video model is optimized to respond to a song’s structure and lyrics.

How the tool works

Users can find Visuals under Create mode. On the web, they can also open it from the three-dot menu on a song in their library, according to The Verge.

To start a video, users choose a reference image. They can pick one of Suno’s character presets, upload their own photo or artwork, or generate an image from a text prompt. They can also choose whether the image serves as the first or last frame, which can help when joining clips.

Other controls let users adjust the aspect ratio and clip length or turn lip sync on and off. A video editing timeline supports the assembly of clips into longer videos and the addition of customizable lyric text. Users can also extend clips, edit them and revise them with new text prompts.

Visuals uses a separate credit system from Suno’s music generator. Anyone can buy Visual credits, and purchased credits do not expire. Pro and Premier subscribers receive a limited number of credits to try the feature for a limited time, according to Suno’s FAQ.

The number of credits required depends on factors including video length and quality. Suno offers Fast and Standard video options. Fast costs fewer credits and is intended for quick ideas, while Standard is designed for more complex ones.

Safeguards and content restrictions

The feature uses H3 Move, a model based on MiniMax’s H3 that Suno says it has adapted for its users. The company says it has added text and image filters intended to block attempts to use or generate representations of specific artists, public figures and copyrighted works.

Suno also says it checks generated images and videos for violations of its community guidelines before showing them to users. It plans to apply embedded watermarks before Visuals can be shared outside the platform.

When users first upload an image or video for Visuals, Suno asks them to confirm that they have the necessary rights. The company says its trust and safety team investigates detected or reported misuse and may remove content or restrict or terminate accounts.

The expansion comes after Suno’s music generator faced high-profile lawsuits. The Verge also notes that some users responding to the launch video called for the company to improve audio generation instead.

Sources

Stay up to date

AI for content creation: the latest tools, tips and trends. Every two weeks in your inbox:

More info …

About the author

Related posts:

Advertisement

×