Petals runs large language models across distributed computers and supports fine-tuning and inference.
Open source
24 alternativesLocalAI
LocalAI runs text, voice, vision, image, video, and agent workloads through an open-source AI engine.
About LocalAI
LocalAI is an open-source (MIT) runtime that runs text, voice, vision, image, video, 3D and agent workloads on local hardware. It exposes an OpenAI-compatible API that also speaks the Anthropic, Ollama and ElevenLabs APIs, so existing clients can often be pointed at it with a URL change rather than a rewrite. The inference engine behind the API is swappable per model among llama.cpp, vLLM, SGLang or MLX through a single config line, and each engine is pulled in as a separate backend only when a model needs it.
Key features
- OpenAI-compatible API, plus Anthropic, Ollama and ElevenLabs compatibility
- Swappable engines per model: llama.cpp, vLLM, SGLang or MLX
- Speech transcription with speaker labels and timestamps; synthesis and voice cloning
- Vision tasks including detection, recognition, depth and 3D reconstruction
- Image, video, music and sound generation
- Agent features such as MCP, skills, RAG and tool calling
Best for: Developers and teams who want to run AI workloads on their own hardware while keeping existing API-based clients working.
Good for
- Every feature ships a CPU path first that is tested in CI, with GPUs optional for speed
- One install covers many workload types because backends are loaded only when requested
- Existing tools built for OpenAI, Anthropic, Ollama or ElevenLabs APIs usually need only a URL change
Watch out for
- Running larger or concurrent workloads requires adding local hardware such as GPUs or extra machines
- Models are not bundled with the runtime; they are pulled from a model gallery as needed
LocalAI at a glance
- Website
- localai.io
- Type
- Online tool
- Pricing
- Not confirmed. Check the site
- Platforms
- Web
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 5, 2026 · Online when checked
- Listed
- Oct 5, 2026
LocalAI alternatives
Tools and sites you could use instead, ranked by how closely they match.
Petals runs large language models at home through a BitTorrent-style approach and supports text generation and fine-tuning.
alphaXiv helps users discover, read, and discuss arXiv papers, with research answers grounded in the underlying work.
LLM-API-Key-Proxy provides a gateway for multiple language model APIs, with compatible endpoints and provider translation.
This bilingual chat language model is described in English and Chinese on the ChatGLM2-6B repository page.
llama.cpp runs open models locally on a computer through the llama.cpp project.
Open source
24 alternativesPopular in AI Chatbots & Assistants
Well-known listings from the same topic.
Lumolumo.proton.meMicrosoft Copilotcopilot.microsoft.comLearn Aboutlearning.google.com/experiments/learn-aboutEidoloneidolonai.comFlowHuntflowhunt.ioPine AI19pine.ai
LocalAI FAQ
What hardware does LocalAI run on?
The project lists x86_64 and ARM64 CPUs, with optional acceleration through CUDA, ROCm, SYCL, Metal and Vulkan. Every feature ships a CPU path first, and a GPU makes it faster but is not required.
Can I reuse my existing API client?
The runtime is described as a drop-in replacement for most upstream APIs. It also speaks the Anthropic, Ollama and ElevenLabs APIs, so many tools need only a URL change.
Does data leave my machine?
The homepage states that models run on your hardware and that names, addresses and card numbers can be redacted on the machine before anything is sent anywhere. Actual data flows depend on how a deployment is configured and whether external services are used.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.