AI Infrastructure

Groq is a neocloud platform for fast AI inference, providing integrated infrastructure and control.

onWatch tracks AI API quotas across providers and displays usage in real time through a lightweight background monitor.

Microtica deploys and monitors cloud-native applications, with agents for infrastructure and incident resolution.

PaddlePaddle provides a deep learning framework for training models across devices and platforms.

Comet's Opik platform provides AI observability, agent testing, evaluation, and monitoring for developers.

FATE supports federated learning through an industrial grade framework.

Orq.ai provides an enterprise AI gateway with access to hundreds of models, guardrails, cost limits, and audit trails.

MimicPC provides an AI platform for generating images, video, and audio, training LoRA models, and adding custom models.

Algorithms for learning and inference with discrete probabilistic models.

MLRun provides an open-source MLOps platform for managing machine learning applications, pipelines, and CI/CD delivery.

FLAML provides a fast Python library for automated machine learning and tuning.

Baseten provides an inference platform for serving and scaling open-source and custom AI models in production.

Kuberns uses AI agents to deploy, scale, and manage applications on cloud infrastructure.

GPTCache provides semantic caching for large language models and integrates with LangChain and LlamaIndex.

OneCompression is a Python package for compressing large language models.

Private AI for individuals, teams, and organizations. Workspaces, agents, models, and knowledge—one connected system on your terms.

Kale simplifies data science workflows for deploying Kubeflow Pipelines.

DeepDetect provides a deep learning server and command-line interface for Torch and TensorRT.

Valohai provides MLOps tools for comparing, evaluating, and shipping configurations for AI products using specialized models.

Xinference runs language, speech, and multimodal models through a unified inference API across cloud, on premises, or laptop setups.

Toolhouse turns AI chats into AI workers that can perform tasks while users are away.

oneDNN provides a library of optimized deep neural network operations for oneAPI.

Mosec serves machine learning models with dynamic batching and CPU or GPU pipelines for inference workloads.

OmniRoute routes requests across hundreds of providers through an OpenAI-compatible endpoint with automatic fallback.