Unsloth

Unsloth provides a local interface for running and training language and diffusion models, including GGUF and MLX support.

github.com/unslothai/unsloth
Unsloth homepage screenshot

About Unsloth

Unsloth is a local interface for running and training language and diffusion models, including GGUF and MLX support. It is available as a desktop app, a web UI called Unsloth Studio, and a code-based version called Unsloth Core, with a Docker image also provided.

It runs on Windows, Linux, WSL, and macOS and lists support for multi-GPU setups, NVIDIA, AMD, and Intel GPUs, CPUs, and the Vulkan backend. Capabilities described include serving models through an OpenAI-compatible API, using local models with agents and tools, and exporting models to GGUF, NVFP4, and FP8 formats.

Key features

  • Run and train LLMs, diffusion, embedding, and audio models locally
  • Supports GGUF and MLX model formats
  • Serve models through an OpenAI-compatible API
  • Fine-tune with LoRA, QLoRA, full fine-tuning, GRPO, DPO, and FP8
  • Export models to GGUF, NVFP4, and FP8 formats
  • Access local models over LAN or remotely via Cloudflare HTTPS
Best for: People who want to run and train language and diffusion models on their own hardware.
Good for
  • Open-source repository
  • Runs on Windows, Linux, WSL, and macOS with NVIDIA, AMD, Intel, CPU, and Vulkan support
  • Offered as desktop app, web UI, code version, and Docker image

Unsloth at a glance

Type
Open-source project
Pricing
Not confirmed. Check the site
Open source
Yes · Source code
Language
English
Last checked
Oct 5, 2026 · Online when checked
Listed
Oct 5, 2026

Unsloth alternatives

Tools and sites you could use instead, ranked by how closely they match.

All 24 alternatives

Popular in AI Infrastructure & MLOps

Well-known listings from the same topic.

All 341

Unsloth FAQ

How is Unsloth installed?
Desktop downloads are listed for Windows, macOS, and Linux, plus install scripts for macOS, Linux, WSL and Windows, a Homebrew cask for macOS, and the Docker image unsloth/unsloth.
What are the different ways to use Unsloth?
Unsloth Desktop is the desktop app, Unsloth Studio is the web UI launched with unsloth studio, and Unsloth Core is the code-based version.
Which operating systems and hardware are supported?
Windows, Linux, WSL, and macOS are supported, with multi-GPU setups, NVIDIA, AMD, and Intel GPUs, CPUs, and the Vulkan backend.
Is something wrong or out of date?

Tell us and an editor will check it.

Own this website?

Claim the listing and suggest updates yourself. An editor checks every claim first.

Claim this listing