nateraw/stable-diffusion-videos

Create videos with Stable Diffusion by exploring the latent space and morphing between text prompts.

github.com/nateraw/stable-diffusion-videos
nateraw/stable-diffusion-videos homepage screenshot

About nateraw/stable-diffusion-videos

nateraw/stable-diffusion-videos is an open-source Python package for creating videos with Stable Diffusion by walking the latent space and morphing between text prompts. It installs with pip install stable_diffusion_videos and uses StableDiffusionWalkPipeline.walk() with prompts, seeds, interpolation steps, output directory, and generation settings.

It supports audio-synced videos where an audio file informs the interpolation rate, configurable height, width, guidance scale and inference steps, and a local interface launched with Interface(pipeline). On Apple M1, torch.float32 must be used because torch.float16 is not available on MPS.

Key features

  • Morph between text prompts by interpolating Stable Diffusion latent space
  • Set prompts, seeds, interpolation steps, output directory and name
  • Adjust image height, width, guidance scale and inference steps
  • Add audio file to align interpolation rate with beat
  • Launch local interface with Interface pipeline wrapper
  • Install package via pip install stable_diffusion_videos
Best for: People with a Python Stable Diffusion setup who want to generate videos by morphing between prompts.
Good for
  • Open source under Apache-2.0 license
  • Includes example scripts and notebooks for videos and music videos
  • Supports audio-informed interpolation and configurable generation parameters
Watch out for
  • Apple M1 requires torch.float32 because torch.float16 is not available on MPS
  • Height and width must use multiples of 64 above 512 and multiples of 8 below 512

nateraw/stable-diffusion-videos at a glance

Type
Open-source project
Pricing
Not confirmed. Check the site
Open source
Yes · Source code
Language
English
Last checked
Oct 6, 2026 · Online when checked
Listed
Oct 5, 2026

nateraw/stable-diffusion-videos alternatives

Tools and sites you could use instead, ranked by how closely they match.

All 24 alternatives

Popular in AI Image Generators

Well-known listings from the same topic.

All 363

nateraw/stable-diffusion-videos FAQ

How do I install the package?
Use pip install stable_diffusion_videos.
Can the video move to music?
Yes, provide a path to an audio file. The audio informs the rate of interpolation.
What change is needed on Apple M1?
Use torch.float32 instead of torch.float16, as float16 is not available on MPS.
Is something wrong or out of date?

Tell us and an editor will check it.

Own this website?

Claim the listing and suggest updates yourself. An editor checks every claim first.

Claim this listing