Mmaudio

github.com/hkchengrex/MMAudio AI Voice & Audio Open-source projectOpen source

MMAudio synthesizes audio from video and text through a multimodal joint-training approach presented at CVPR 2025.

github.com/hkchengrex/MMAudio
Mmaudio homepage screenshot

About Mmaudio

MMAudio generates synchronized audio given video and/or text inputs. Its multimodal joint training allows training on audio-visual and audio-text datasets, while a synchronization module aligns generated audio with video frames. It was presented as a CVPR 2025 Highlight.

Pricing is not clearly stated.

Key features

  • Command-line demo saves FLAC audio and MP4 video to ./output
  • Gradio interface supports video-to-audio and text-to-audio synthesis
  • Experimental image-to-audio duplicates input image as video for processing
  • Pretrained models download automatically and are also on Hugging Face
Good for
  • Inference takes around 6GB of GPU memory in 16-bit mode
Watch out for
  • Only tested on Ubuntu
  • Large deviation from 8-second training duration may lower quality
  • Higher-resolution video takes longer without improving quality
  • Pre-trained models are not guaranteed suitable for commercial use

Mmaudio at a glance

Type
Open-source project
Pricing
Not confirmed. Check the site
Details verified
Oct 22, 2026 · Official source
Open source
Yes · Source code
Language
English
Last checked
Oct 5, 2026 · Online when checked
Listed
Oct 5, 2026

Mmaudio alternatives

Tools and sites you could use instead, ranked by how closely they match.

All 19 alternatives

Popular in AI Voice & Audio

Well-known listings from the same topic.

All 227
Is something wrong or out of date?

Tell us and an editor will check it.

Own this website?

Claim the listing and suggest updates yourself. An editor checks every claim first.

Claim this listing