1
Also covers llm and open source · same kind of open-source project
SillyTavern is a frontend for users working with large language models.
Alternatives
The Best Llama.cpp Alternatives in 2026
24 alternatives0 free · 13 open source
Looking for something like Llama.cpp? Here are 24 alternatives, ranked by how closely they match it on purpose, features and platforms. Of these, 13 are open source.
llama.cpp provides inference for large language models through a C and C++ project.
Top picks at a glance
First suggestionSilly TavernSillyTavern is a frontend for users working with large…Another optionGenerative AI DocsTextFX is a deprecated AI experiment from Google Creative…
Quick comparison
| # | Alternative | Pricing | Open source | Platforms |
|---|---|---|---|---|
| 1 | Silly Tavern | — | Yes | — |
| 2 | Generative AI Docs | — | Yes | — |
| 3 | KoboldCpp | — | Yes | — |
| 4 | Ollama | — | Yes | — |
| 5 | Petals | — | Not stated | Web |
| 6 | Autonomous HR Chatbot | — | Yes | Windows |
| 7 | Alpaca-LoRA-Serve | — | Yes | — |
| 8 | RasaGPT | — | Yes | — |
| 9 | Petals | — | Yes | — |
| 10 | LLM-API-Key-Proxy | — | Not stated | — |
All Llama.cpp alternatives
2
Also covers llm and open source · same kind of open-source project
TextFX is a deprecated AI experiment from Google Creative Lab for exploring language and text.
3
Also covers llm and open source · same kind of open-source project
KoboldCpp runs GGUF models through a KoboldAI interface in a single-file application.
4
Also covers llm and open source · same kind of open-source project
Ollama helps users run and work with open models through a local AI tool.
5
Petals
petals.devAlso covers llm
Petals runs large language models at home through a BitTorrent-style approach and supports text generation and fine-tuning.
6
Also covers llm and open source · same kind of open-source project
This HR chatbot answers user questions with tools through an autonomous agent workflow.
7
Also covers llm and open source · same kind of open-source project
This project describes serving an LLM as a chatbot service through a multi-agent framework.
8
Also covers llm and open source · same kind of open-source project
RasaGPT is the first headless LLM chatbot platform built on top of Rasa and Langchain.
9
Also covers open source · same kind of open-source project
Petals runs large language models across distributed computers and supports fine-tuning and inference.
10
LLM-API-Key-Proxy
github.com/Mirrowel/LLM-API-Key-ProxyAlso covers llm · same kind of open-source project
LLM-API-Key-Proxy provides a gateway for multiple language model APIs, with compatible endpoints and provider translation.
11
ChatGLM2-6B
github.com/zai-org/ChatGLM2-6BAlso covers llm · same kind of open-source project
This bilingual chat language model is described in English and Chinese on the ChatGLM2-6B repository page.
12
llamafile
github.com/Mozilla-Ocho/llamafileAlso covers llm · same kind of open-source project
llamafile packages language models so they can be distributed and run as a single file.
13
Inception
chat.inceptionlabs.aiAlso covers llm
Inception Chat provides conversation with Mercury, a commercial diffusion language model.
14
Open Webui
github.com/open-webui/open-webuiAlso covers llm · same kind of open-source project
Open WebUI provides an interface for using AI models, including Ollama and the OpenAI API.
15
Private GPT
privategpt.ioAlso covers llm
Connect your own data sources to a private AI powered tool and start asking in natural language.
16
Solar
console.upstage.ai/playground/chatAlso covers llm
Solar lets users try Upstage language and document AI tools in a browser, including chat, document parsing, OCR, and file questions.
17
Also covers open source · same kind of open-source project
Lollms Webui provides a web user interface for large language and multimodal systems.
18
KoboldAI
koboldai.comAlso covers llm
KoboldAI provides local AI tools, including an API server, a lightweight interface, and a hosted service.
19
Owlbot
owlbot.aiAlso covers llm
Owlbot lets companies create AI chatbots and workflows trained on their business information.
20
LLMStack
llmstack.aiAlso covers llm
LLMStack lets users build generative AI apps, chatbots, and agents with data through a no-code platform.
21
Also covers open source · same kind of open-source project
LLMFlows provides components for building language model applications with explicit workflows.
22
Also covers open source · same kind of open-source project
NextChat is an AI chat assistant client that supports named language models and is available on web and several desktop and mobile platforms.
23
Also covers open source · same kind of open-source project
AnythingLLM is a local-first platform for using AI agents and language models in a self-managed workspace.
24
Also covers open source · same kind of open-source project
The ch.at project describes a lightweight language model chat service available through HTTP, SSH, DNS, and an API.
No alternatives match this filter.
Alternatives to similar tools
Open Webui24 alternativesAutonomous HR Chatbot24 alternativesPrivate GPT19 alternativesLLMStack24 alternativesChatGPT-Next-Web24 alternativesAnything Llm24 alternatives
What is the best alternative to Llama.cpp?
Based on features, tags and platforms, the closest alternatives to Llama.cpp are Silly Tavern, Generative AI Docs, and KoboldCpp.
Are there open-source alternatives to Llama.cpp?
Yes: Silly Tavern, Generative AI Docs, KoboldCpp, and Ollama.
Alternatives are suggested from the purpose and features described in our listings. Different pages for the same product appear once. Read each description to check whether it fits your task. How we choose alternatives · Suggest an alternative