The Best LiteLLM Alternatives in 2026

OneCompression is a Python package for compressing large language models.

The abso TypeScript SDK calls more than 100 LLM providers through an OpenAI compatible format.

Chutes provides serverless compute for deploying, running, and scaling AI models through its platform and API.

This repository contains utilities intended for use with Llama models.

Notte provides cloud browser infrastructure and web automation for AI and coding agents.

PromptSite provides prompt version management for tracking, experimentation, and debugging LLM prompts.

DeepEval is an LLM evaluation framework, according to its repository description.

Semantic Cache Router presents a distributed semantic cache and stateful routing system.

Quickly understand inscrutable LLM frameworks by intercepting API calls.

LiteLLM provides an AI gateway and LLM proxy with model routing, usage tracking, spend controls, and support for many providers.

LLM Gateway routes, manages, and analyzes requests across more than 40 language-model providers through one API.

Kimi K2 handles complex language tasks, reasoning, and problem-solving through an AI model developed by Moonshot AI.

Upstage builds large language models and document-processing engines for workplace workflows.

Flaq offers one API for accessing AI image, video, 3D, music, and language models.

autobatcher batches asynchronous OpenAI-compatible API requests through a drop-in replacement library.

Compose, test, and optimize prompts for language-model applications in Promptmetheus, an IDE supporting more than 100 models.

Eden AI routes requests across language and other AI models through a unified API with provider options.

Ollama runs language models locally and provides tools to work with model files and APIs.

Mirai Labs builds uzu, a Rust LLM engine for Apple devices, with compact Qwen, LFM, and Muse-Glimmer models.

Featherless is a serverless AI inference platform for open-weight models with API access to tens of thousands of models.

Valohai provides MLOps tools for comparing, evaluating, and shipping configurations for AI products using specialized models.

Confident AI provides evaluation, observability, red-teaming, and governance tools for testing and monitoring AI systems.

Comet's Opik platform provides AI observability, agent testing, evaluation, and monitoring for developers.

Vercel’s AI SDK is a TypeScript toolkit for building AI applications and agents with React, Next.js, Vue, Svelte, and Node.js.