LocalAI runs text, voice, vision, image, video, and agent workloads through an open-source AI engine.
Open source
24 alternativesOllama
vsllama.cpp
Ollama vs llama.cpp
How do Ollama and llama.cpp compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | Ollama | llama.cpp |
|---|---|---|
| What it is | Ollama runs open models for coding agents while keeping model use local. | llama.cpp runs open models locally on a computer through the llama.cpp project. |
| Website | ||
| Type | Website | Online tool |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Web | Web |
| Open source | Not stated | Yes |
| Language | — | English |
| Alternatives |
Other options to consider
Sites similar to both Ollama and llama.cpp.
This KoboldCpp variant runs GGML models with AMD ROCm offloading and the KoboldAI interface.
Open source
24 alternatives
Petals runs large language models across distributed computers and supports fine-tuning and inference.
Open source
24 alternatives
GPT4All runs language models locally on a range of devices through open-source software.
Open source
24 alternatives
KoboldCpp runs GGUF models through a KoboldAI interface in a single-file application.
Open source
24 alternatives
LocalGPT lets users chat with documents on their local device using GPT models.
Open source
24 alternatives