LLM Gateway routes, manages, and analyzes requests across more than 40 language-model providers through one API.
LiteLLM
LiteLLM provides an AI gateway and LLM proxy with model routing, usage tracking, spend controls, and support for many providers.
About LiteLLM
LiteLLM is an AI gateway and LLM proxy that consolidates access to multiple AI models, agents, and MCP servers behind a single OpenAI-compatible API key. It supports 140+ providers and 1,800+ models, and includes features for model routing, spend tracking and capping, and team-scoped access with SSO.
The tool can be self-hosted, including in air-gapped environments, and integrates with existing secret managers for key management.
Key features
- Single OpenAI-compatible API for 140+ providers and 1,800+ models
- Model routing to assign requests to appropriate AI models
- Spend tracking and budget capping for LLM usage
- Team-scoped access with SSO for organizational use
- Self-hosting support including air-gapped deployments
- Integration with existing secret managers for key management
Best for: Platform teams that need to consolidate, govern, and optimize access to multiple LLM models across their organization.
Good for
- Eliminates code changes when switching backend LLM models
- Can reduce AI task costs (example: 56% cut for coding tasks at AT&T)
- Offers day-zero support for newly released LLM models
LiteLLM at a glance
- Website
- litellm.ai
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Platforms
- Web
- Open source
- Not stated
- Language
- English
- Last checked
- Oct 5, 2026 · Online when checked
- Listed
- Oct 5, 2026
LiteLLM alternatives
Tools and sites you could use instead, ranked by how closely they match.
Bifrost by Maxim AI is an open-source AI gateway for LLMs, MCP and agents with routing, governance, guardrails and observability, supporting 8+ providers and 1000+ models via a drop-in SDK replacement.
FreemiumOpen source
24 alternatives
Glide provides an open model gateway for developing production generative AI applications.
Open source
24 alternatives
The abso TypeScript SDK calls more than 100 LLM providers through an OpenAI compatible format.
Open source
24 alternatives
Guardrails AI provides a framework for building, governing, and deploying reliability controls for generative AI systems.
TensorZero builds open-source tools for production-grade LLM applications: LLM gateway, observability, optimization, evaluations, and experimentation.
Popular in AI Infrastructure & MLOps
Well-known listings from the same topic.
Guild AIguild.aiFlow AIflow-ai.comsystemprompt.iosystemprompt.ioCoreWeavecoreweave.comKili Technologykili-technology.comAPI docsdocs.x.ai
LiteLLM FAQ
Can LiteLLM be deployed in air-gapped environments?
Yes, it supports self-hosting including in air-gapped deployments.
Is code modification required to switch LLM models via LiteLLM?
No, switching backend models only requires a configuration update in the gateway.
What types of AI resources can be accessed through LiteLLM?
It supports LLMs, agents, and MCP servers from 140+ providers.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.