PrivateGPT provides an API layer for private AI applications using local models, retrieval, tools, and MCP.
PrivateGPT
PrivateGPT provides an API layer for building private AI applications with local model inference.

About PrivateGPT
PrivateGPT is an API layer for building AI applications that run on local models. It provides building blocks such as a Messages API with streaming, file and artifact ingestion, retrieval with citations, and access to databases and CSV files. The API follows the Claude API model, so tools built for Claude-style or OpenAI-compatible interfaces can connect to it. The homepage also includes a built-in /ui workbench for testing, demos, and inspecting API requests.
The homepage states that PrivateGPT is designed to keep data inside the user's environment. This depends on the setup. Connecting MCP tools to online providers, or using external services such as n8n, can send data outside the local environment. The homepage describes PrivateGPT as the open-source application layer and points enterprise needs such as deployment, governance, user management, and auditability to Zylon, a separate product by the same team. Pricing is not stated on the homepage.
Key features
- Messages API with streaming, async processing, and token counting
- Upload and process documents and artifacts as context for AI workflows
- Retrieval-augmented answers with source citations
- Access to databases, CSVs, and tabular data through the API
- Coordinates embeddings, retrieval, tools, and model calls behind one API
- Custom tools and MCP connectors, run locally or with chosen online providers
- Provides a Messages API with streaming, async processing, and token counting
- Supports local model servers including Ollama, llama.cpp, vLLM, and LocalAI
- Works with tools that support a local OpenAI-compatible provider
- Enterprise features such as RBAC, LDAP support, and SIEM audit logs are listed for Zylon, not PrivateGPT
- Connecting MCP tools or workflows to online providers can send data outside the local environment
- Pricing is not stated on the homepage
PrivateGPT at a glance
- Website
- privategpt.dev
- Type
- Online tool
- Pricing
- Not confirmed. Check the site
- Platforms
- Web
- Open source
- Not stated
- Language
- English
- Last checked
- Oct 6, 2026 · Online when checked
- Listed
- Oct 5, 2026
PrivateGPT alternatives
Tools and sites you could use instead, ranked by how closely they match.
Cerebras Inference provides a service for running AI models from Cerebras.
Petals runs large language models across distributed computers and supports fine-tuning and inference.
Ollama runs open models for coding agents while keeping model use local.
Compare local AI model compatibility with a selected GPU or VRAM, including context size and token speed.
LM Studio lets users discover, download, and run local language models on Mac, Linux, or Windows.
Popular in AI Chatbots & Assistants
Well-known listings from the same topic.
PrivateGPT FAQ
Which local model servers does PrivateGPT support?
What is the difference between PrivateGPT and Zylon?
Can it be used without an internet connection?
Tell us and an editor will check it.
Claim the listing and suggest updates yourself. An editor checks every claim first.











