1
Also covers computer, git, and open source
poorcoder provides Bash scripts that connect web-based AI interfaces with a terminal coding workflow.
Alternatives
The Best llama.cpp Alternatives in 2026
24 alternatives0 free · 23 open source
Looking for something like llama.cpp? Here are 24 alternatives, ranked by how closely they match it on purpose, features and platforms. Of these, 23 are open source.
llama.cpp runs open models locally on a computer through the llama.cpp project.
Top picks at a glance
First suggestionpoorcoderpoorcoder provides Bash scripts that connect web-based AI…Another optionOpenAgentOpenAgent supports personal AI tasks involving retrieval…
Quick comparison
| # | Alternative | Pricing | Open source | Platforms |
|---|---|---|---|---|
| 1 | poorcoder | — | Yes | — |
| 2 | OpenAgent | — | Yes | — |
| 3 | Mamba-Chat | — | Yes | — |
| 4 | Gpt4all | — | Yes | Linux, macOS, Windows |
| 5 | Petals | — | Yes | — |
| 6 | GitLoop | — | Not stated | Web |
| 7 | Jan | — | Yes | — |
| 8 | LocalAI | — | Yes | Web |
| 9 | ROCm | — | Yes | — |
| 10 | KoboldCpp | — | Yes | — |
All llama.cpp alternatives
2
Also covers computer and open source
OpenAgent supports personal AI tasks involving retrieval, browser and computer use, and coding assistance.
3
Also covers git and open source
The Mamba-Chat model supports chat and uses a state space model architecture.
4
Also covers open source
GPT4All runs language models locally on a range of devices through open-source software.
5
Also covers open source
Petals runs large language models across distributed computers and supports fine-tuning and inference.
6
GitLoop
gitloop.comAlso covers git · same kind of online tool
GitLoop lets developers search codebases in natural language, generate documentation and tests, and review pull requests.
7
Also covers open source
Jan runs an offline AI chat assistant on a personal computer as an open-source ChatGPT alternative.
8
Also covers open source · same kind of online tool
LocalAI runs text, voice, vision, image, video, and agent workloads through an open-source AI engine.
9
Also covers open source
This KoboldCpp variant runs GGML models with AMD ROCm offloading and the KoboldAI interface.
10
Also covers open source
KoboldCpp runs GGUF models through a KoboldAI interface in a single-file application.
11
Also covers open source · same kind of online tool
Open WebUI provides a self hosted platform for connecting AI models and extending the interface with code.
12
Also covers open source · same kind of online tool
NeverWrite combines local notes and documents with an AI knowledge base that asks before making changes.
13
Also covers open source · same kind of online tool
LibreChat brings AI conversations together in a unified, customizable interface.
14
Also covers open source · same kind of online tool
DocsGPT answers questions over company documents through an open-source and self-hosted retrieval-augmented generation platform.
15
Also covers open source
The ch.at project describes a lightweight language model chat service available through HTTP, SSH, DNS, and an API.
16
Also covers open source
Intelli builds chatbots and agents from user-defined intents and model choices.
17
Also covers open source
LocalGPT lets users chat with documents on their local device using GPT models.
18
Also covers open source
LLMFlows provides components for building language model applications with explicit workflows.
19
Also covers open source
NextChat is an AI chat assistant client that supports named language models and is available on web and several desktop and mobile platforms.
20
Also covers open source
chatbot-ui provides an AI chat interface for working with different models.
21
Also covers open source
OpenChatKit provides an open-source base for creating specialized or general-purpose chat models.
22
Also covers open source
Marinara Engine provides a graphical frontend to interact with AI models.
23
Also covers open source
Use lucinate as a terminal chat client for agents and OpenAI-compatible model providers.
24
Also covers open source
AnythingLLM is a local-first platform for using AI agents and language models in a self-managed workspace.
No alternatives match this filter.
Alternatives to similar tools
poorcoder24 alternativesLocal GPT24 alternativesSource code24 alternativesMarinara Engine24 alternativesChatGPT-Next-Web24 alternativesAnything Llm24 alternatives
What is the best alternative to llama.cpp?
Based on features, tags and platforms, the closest alternatives to llama.cpp are poorcoder, OpenAgent, and Mamba-Chat.
Are there open-source alternatives to llama.cpp?
Yes: poorcoder, OpenAgent, Mamba-Chat, and Gpt4all.
Alternatives are suggested from the purpose and features described in our listings. Different pages for the same product appear once. Read each description to check whether it fits your task. How we choose alternatives · Suggest an alternative