Petals runs large language models across distributed computers and supports fine-tuning and inference.
Open source
24 alternativesllama.cpp
vsJan
llama.cpp vs Jan
How do llama.cpp and Jan compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | llama.cpp | Jan |
|---|---|---|
| What it is | llama.cpp runs open models locally on a computer through the llama.cpp project. | Jan runs an offline AI chat assistant on a personal computer as an open-source ChatGPT alternative. |
| Website | ||
| Type | Online tool | Open-source project |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Web | Not recorded |
| Open source | Yes | Yes |
| Language | English | English |
| Alternatives |
Other options to consider
Sites similar to both llama.cpp and Jan.
Open WebUI provides a self hosted platform for connecting AI models and extending the interface with code.
Open source
24 alternatives
GPT4All runs language models locally on a range of devices through open-source software.
Open source
24 alternatives
DocsGPT answers questions over company documents through an open-source and self-hosted retrieval-augmented generation platform.
Open source
24 alternatives
OpenAgent supports personal AI tasks involving retrieval, browser and computer use, and coding assistance.
Open source
24 alternatives
LocalGPT lets users chat with documents on their local device using GPT models.
Open source
24 alternatives