The abso TypeScript SDK calls more than 100 LLM providers through an OpenAI compatible format.
Open source
24 alternativesLiteLLM
vsLLM Gateway
LiteLLM vs LLM Gateway
How do LiteLLM and LLM Gateway compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | LiteLLM | LLM Gateway |
|---|---|---|
| What it is | LiteLLM provides a way to call more than 100 language models through an OpenAI-compatible interface. | LLM Gateway routes, manages, and analyzes requests across more than 40 language-model providers through one API. |
| Website | ||
| Type | Online tool | Online tool |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Web | Web |
| Open source | Not stated | Not stated |
| Language | English | English |
| Alternatives |
Other options to consider
Sites similar to both LiteLLM and LLM Gateway.
LiteLLM provides an AI gateway and LLM proxy with model routing, usage tracking, spend controls, and support for many providers.
Flaq offers one API for accessing AI image, video, 3D, music, and language models.
Ollama runs language models locally and provides tools to work with model files and APIs.
Open source
24 alternatives
Featherless is a serverless AI inference platform for open-weight models with API access to tens of thousands of models.
Paid
24 alternatives
Confident AI provides evaluation, observability, red-teaming, and governance tools for testing and monitoring AI systems.