PrivateGPT provides an API layer for private AI applications using local models, retrieval, tools, and MCP.
Open source
24 alternativesLocal GPT
LocalGPT lets users chat with documents on their local device using GPT models.
About Local GPT
LocalGPT is an open-source Python project for asking questions about documents on a local device. It processes PDF, DOCX, HTML/HTM, Markdown, and TXT files and returns answers with the source chunks used for grounding.
The project describes data as staying on the user's computer. It combines dense vector search with full-text search, a cross-encoder reranker, and per-query routing between retrieval-based and direct model answers. Generation models are swapped via Ollama, with embeddings from HuggingFace models or Ollama tags.
Key features
- Chat with PDF, DOCX, HTML, Markdown, and TXT files locally
- Swap generation models via Ollama and reuse downloaded models
- Use HuggingFace or Ollama embedding models
- Answers include source chunks used for grounding
- REST gateway and RAG API for custom applications
- Automatic selection of CUDA, Apple MPS, or CPU
Best for: People who want to run an open-source chat-over-documents setup on their own machine.
Good for
- Processes multiple document types with OCR fallback for PDFs without text
- Provides source chunks with answers for grounding
- Includes REST and RAG APIs for building applications
Local GPT at a glance
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 5, 2026 · Online when checked
- Listed
- Oct 5, 2026
Local GPT alternatives
Tools and sites you could use instead, ranked by how closely they match.
OpenChatKit provides an open-source base for creating specialized or general-purpose chat models.
Open source
24 alternatives
Intelli builds chatbots and agents from user-defined intents and model choices.
Open source
24 alternatives
Jupyter AI adds an AI chat interface and agent capabilities to JupyterLab notebooks.
Open source
24 alternatives
Jan runs an offline AI chat assistant on a personal computer as an open-source ChatGPT alternative.
Open source
24 alternatives
Petals runs large language models across distributed computers and supports fine-tuning and inference.
Open source
24 alternativesPopular in AI Chatbots & Assistants
Well-known listings from the same topic.
Lumolumo.proton.meMicrosoft Copilotcopilot.microsoft.comLearn Aboutlearning.google.com/experiments/learn-aboutEidoloneidolonai.comFlowHuntflowhunt.ioPine AI19pine.ai
Local GPT FAQ
What document formats can LocalGPT process?
PDF, DOCX, HTML/HTM, Markdown, and TXT, parsed by Docling, with OCR fallback for PDFs without a text layer.
How are models handled?
Generation models can be swapped via Ollama, embeddings can use HuggingFace models or Ollama tags, and downloaded models can be reused without repeated downloads.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.