AI Infrastructure & MLOps

GPT-NeoX implements model parallel autoregressive transformers on GPUs using Megatron and DeepSpeed libraries.

txtai combines semantic search, language-model orchestration and AI workflows in an open-source framework.

Butterfree provides tools for building feature stores and transforming raw data.

Feathr provides enterprises with a platform for data engineering and AI workflows.

Guardrails AI provides a framework for building, governing, and deploying reliability controls for generative AI systems.

PromptSite provides prompt version management for tracking, experimentation, and debugging LLM prompts.

ClearML provides AI infrastructure for managing GPU clusters, machine learning workflows, and model deployment.

PyTorch Lightning supports pretraining and fine tuning AI models across GPU setups.

Curate and annotate vision, audio, and LLM datasets, track experiments, and manage models on a single platform.

Glide provides an open model gateway for developing production generative AI applications.

Zilliz Cloud provides a managed vector data platform powered by Milvus, with real-time search and data operations across major cloud regions.

Firecrawl provides a web data API for searching and scraping pages for AI agents.

LiteLLM provides a way to call more than 100 language models through an OpenAI-compatible interface.

Radicalbit AI Monitoring provides a solution for monitoring machine learning models in production.

AI/ML API provides access to models for text, images, video, audio, code, and embeddings through one API.

Omnifact provides team access to multiple AI models and pseudonymizes personal data before sending prompts to providers.

OpenRouter offers one API interface for finding and using hundreds of AI models across text, image, video, and audio providers.

Metorial connects employees, agents, and AI clients to company tools and skills with access controls and tracing.

Quickly understand inscrutable LLM frameworks by intercepting API calls.

Candle provides a minimalist Rust framework for machine learning model development and execution tasks.

ONNX-MLIR compiles ONNX models using MLIR compiler infrastructure for model deployment workflows.

Snowgoose provides access to models from OpenAI, Anthropic, Google, and other providers in one AI workspace.

Semantic Cache Router presents a distributed semantic cache and stateful routing system.

Stakpak runs an agent on a machine to ship code and keep applications running.