AI Infrastructure

Route requests to multiple AI providers and models through OmniRoute, a gateway with fallback and quota features.

Democratize and productionize Gen AI across your entire org with Portkey.

Helicone provides open-source observability for LLM applications, with tools to monitor, evaluate, and experiment.

tfdeploy evaluates TensorFlow graphs and exports them to run with NumPy in environments without TensorFlow.

agenttrace audits coding-agent sessions, tracking costs, tokens, latency, failures, and health.

Deep learning in Rust, with shape checked tensors and neural networks.

RunThisLLM lists hardware requirements, build specs, performance estimates, and benchmarks for more than 295 AI models.

The climin package provides optimization methods focused on machine learning scenarios in Python.

Wallaroo provides inference microservices for running models on CPUs or GPUs across cloud and edge environments.

MakeHub routes AI model requests among providers such as OpenAI, Anthropic, and Together.ai.

Apertus provides a nonprofit public inference service intended to make public and sovereign AI models more accessible.

Deepchecks evaluates and monitors AI agents using testing, tracing, dataset scoring, and production observability tools.

Jan provides an open source ChatGPT alternative for running models locally or connecting to cloud models.

Google Cloud’s Gemini Enterprise Agent Platform, formerly Vertex AI, helps developers build, scale, govern, and optimize agents.

Train and run open models locally with Unsloth, an open-source desktop interface for model workflows.

Pollinations provides an API for building AI apps, with user wallets and developer earnings.

Deploy and manage AI agents on company data with enterprise controls for governance and security.

The SpaceXAI API console offers developer tools for Grok text, voice, and image generation APIs.

MyVibe uses AI to turn web projects into deployable apps through an upload, conversion, and publishing workflow.

GAIB lets users mint AID by depositing USDC on Ethereum; the synthetic dollar is described as backed by cash and U.S. Treasuries.

Scrapybara built computer environments for agents and is now developing Capy, an AI software engineer.

Prodia provides developer infrastructure for turning AI models into production workflows.