KoboldCpp runs GGUF models through a KoboldAI interface in a single-file application.
Open source
24 alternativesROCm
This KoboldCpp variant runs GGML models with AMD ROCm offloading and the KoboldAI interface.
About ROCm
ROCm is a KoboldCpp variant for AMD that runs GGML models with ROCm offloading through the KoboldAI interface. It is distributed as a single-file executable with no installation or external dependencies, and can run on CPU or GPU with full or partial offload.
It covers text generation for GGML and GGUF models, image generation and editing, video generation, speech-to-text, text-to-speech, music generation, and vision input, plus compatible API endpoints for listed services. Model weights are not included and must be obtained or generated separately.
Key features
- Runs GGML and GGUF models with AMD ROCm offloading
- Runs on CPU or GPU with full or partial offload
- Generates and edits images with Stable Diffusion, SDXL, SD3, Flux and others
- Transcribes speech with Whisper and generates speech with listed TTS engines
- Offers compatible API endpoints for OpenAI, Ollama, and other listed services
- Includes KoboldAI Lite UI with memory, world info, and character tools
Best for: People with AMD hardware who want to run GGML models locally with a KoboldAI interface.
Good for
- Single-file executable with no installation or external dependencies
- Supports CPU or GPU execution with full or partial offload
- Open source repository with bundled KoboldAI Lite UI
Watch out for
- Model weights are not included and must be obtained or generated separately
ROCm at a glance
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 6, 2026 · Online when checked
- Listed
- Oct 5, 2026
ROCm alternatives
Tools and sites you could use instead, ranked by how closely they match.
Petals runs large language models across distributed computers and supports fine-tuning and inference.
Open source
24 alternatives
GPT4All runs language models locally on a range of devices through open-source software.
Open source
24 alternatives
chatbot-ui provides an AI chat interface for working with different models.
Open source
24 alternatives
LibreChat is an open-source chat interface with agent, model switching, message search, and self-hosting features.
Open source
24 alternatives
KoboldAI provides generative AI software optimized for fictional use, with broader capabilities described by its project.
Open source
24 alternativesPopular in AI Chatbots & Assistants
Well-known listings from the same topic.
Lumolumo.proton.meMicrosoft Copilotcopilot.microsoft.comLearn Aboutlearning.google.com/experiments/learn-aboutEidoloneidolonai.comFlowHuntflowhunt.ioPine AI19pine.ai
ROCm FAQ
Does this download include model weights?
No. Weights are not included; the documentation points to using official llama.cpp quantize.exe to generate them from official weights.
How is it used on Windows?
Download the latest .exe release or clone the repository. Windows binaries are provided as koboldcpp_rocm.exe, described as a pyinstaller wrapper for .dll files and koboldcpp.py.
Does it require installation?
No. It is described as a single file executable with no installation required and no external dependencies.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.