UnificAlly provides one API for generating video, images, music, and speech across more than 100 AI models.
AudioLDM
Text-to-Audio Generation with Latent Diffusion Models - Speech Research.
About AudioLDM
AudioLDM is a research project and demonstration page for text-to-audio generation. It uses latent diffusion models to create sound effects, human speech, and music from text descriptions. The homepage describes a system trained on AudioCaps using a single GPU, with the latent space built from contrastive language-audio pretraining (CLAP) latents. The page presents demonstration samples for prompts about environments, materials, and pitch, along with zero-shot audio editing. The homepage is written by researchers from the University of Surrey and Imperial College London and links to an arXiv paper, a code page, and a Hugging Face Space. It does not state pricing.
Key features
- Generates sound effects, human speech, and music from text descriptions
- Zero-shot text-guided audio style transfer, inpainting, and super-resolution
- Demonstrations of acoustic environment control, such as small room, huge room, or studio
- Demonstrations of material control, such as chopping sounds on wooden or metal tables
- Demonstrations of temporal order control for sequences of sounds in one prompt
- Latent diffusion approach trained on AudioCaps using a single GPU
Best for: Researchers and developers studying text-to-audio generation who want to examine a latent diffusion approach to sound synthesis.
Good for
- The homepage reports state-of-the-art text-to-audio results on objective and subjective metrics.
- The homepage describes zero-shot audio manipulation from pretrained models, without task-specific training.
AudioLDM at a glance
- Website
- audioldm.github.io
- Category
- AI & Machine Learning › AI Voice & Audio
- Type
- Website
- Pricing
- Not confirmed. Check the site
- Platforms
- Web
- Open source
- Not stated
- Language
- English
- Last checked
- Oct 6, 2026 · Online when checked
- Listed
- Oct 5, 2026
AudioLDM alternatives
Tools and sites you could use instead, ranked by how closely they match.
The wav2letter project provides an automatic speech recognition toolkit from Facebook AI Research.
TTS-WebUI is a Gradio and React interface with extensions for speech, audio, and music generation tools.
Open source
9 alternatives
Hypergro creates AI videos from text and images, with a workflow for managing video campaigns and social content.
Free trial
5 alternatives
NeMo Parakeet ASR Models attain strong speech recognition accuracy while being efficient for inference. Available in CTC and RNN-Transducer variants.
The whisper.cpp project ports OpenAI’s Whisper speech recognition model to C and C++.
Open source
24 alternativesPopular in AI Voice & Audio
Well-known listings from the same topic.
Google Illuminateilluminate.google.comAlteredaltered.aiELSA Speakelsaspeak.comKreadoAIkreadoai.comPodwisepodwise.aiAddsubtitleaddsubtitle.ai
AudioLDM FAQ
Was the model trained with text labels?
The homepage states that the latent diffusion model is trained without text supervision. Text is used as the condition during sampling.
What types of audio does AudioLDM generate?
The homepage states that AudioLDM generates text-conditional sound effects, human speech, and music.
Is pricing available?
Pricing is not stated on the homepage.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.