The Best LocalAI Alternatives in 2026

Petals runs large language models across distributed computers and supports fine-tuning and inference.

Petals runs large language models at home through a BitTorrent-style approach and supports text generation and fine-tuning.

alphaXiv helps users discover, read, and discuss arXiv papers, with research answers grounded in the underlying work.

LLM-API-Key-Proxy provides a gateway for multiple language model APIs, with compatible endpoints and provider translation.

This bilingual chat language model is described in English and Chinese on the ChatGLM2-6B repository page.

llama.cpp runs open models locally on a computer through the llama.cpp project.

Pipecat provides an open-source framework for developing real-time voice agents and multimodal AI applications.

Jan runs an offline AI chat assistant on a personal computer as an open-source ChatGPT alternative.

This KoboldCpp variant runs GGML models with AMD ROCm offloading and the KoboldAI interface.

KoboldCpp runs GGUF models through a KoboldAI interface in a single-file application.

GPT4All runs language models locally on a range of devices through open-source software.

NeverWrite combines local notes and documents with an AI knowledge base that asks before making changes.

LibreChat brings AI conversations together in a unified, customizable interface.

Open WebUI provides a self hosted platform for connecting AI models and extending the interface with code.

DocsGPT answers questions over company documents through an open-source and self-hosted retrieval-augmented generation platform.

Jupyter AI adds an AI chat interface and agent capabilities to JupyterLab notebooks.

This HR chatbot answers user questions with tools through an autonomous agent workflow.

LibreChat is an open-source chat interface with agent, model switching, message search, and self-hosting features.

Build personal AI agents with nanobot, a self-hosted Python framework that includes web UI, tools, memory, and integrations.

Intelli builds chatbots and agents from user-defined intents and model choices.

This project describes serving an LLM as a chatbot service through a multi-agent framework.

Agno provides a framework and runtime for building, running, and managing agent platforms.

Use lucinate as a terminal chat client for agents and OpenAI-compatible model providers.

AnythingLLM is a local-first platform for using AI agents and language models in a self-managed workspace.