AI Infrastructure

Torchvision provides datasets, transforms, and models for computer vision with PyTorch.

Hugging Face Text Embeddings Inference serves text embedding models through an inference solution.

GPT-NeoX implements model parallel autoregressive transformers on GPUs using Megatron and DeepSpeed libraries.

txtai combines semantic search, language-model orchestration and AI workflows in an open-source framework.

Butterfree provides tools for building feature stores and transforming raw data.

Feathr provides enterprises with a platform for data engineering and AI workflows.

Guardrails AI provides a framework for building, governing, and deploying reliability controls for generative AI systems.

PromptSite provides prompt version management for tracking, experimentation, and debugging LLM prompts.

ClearML provides AI infrastructure for managing GPU clusters, machine learning workflows, and model deployment.

PyTorch Lightning supports pretraining and fine tuning AI models across GPU setups.

Curate and annotate vision, audio, and LLM datasets, track experiments, and manage models on a single platform.

Glide provides an open model gateway for developing production generative AI applications.

Zilliz Cloud provides a managed vector data platform powered by Milvus, with real-time search and data operations across major cloud regions.

Firecrawl provides a web data API for searching and scraping pages for AI agents.

LiteLLM provides a way to call more than 100 language models through an OpenAI-compatible interface.

Radicalbit AI Monitoring provides a solution for monitoring machine learning models in production.

Ollama runs language models locally and provides tools to work with model files and APIs.

Omnifact provides team access to multiple AI models and pseudonymizes personal data before sending prompts to providers.

OpenRouter offers one API interface for finding and using hundreds of AI models across text, image, video, and audio providers.

Quickly understand inscrutable LLM frameworks by intercepting API calls.

Candle provides a minimalist Rust framework for machine learning model development and execution tasks.

ONNX-MLIR compiles ONNX models using MLIR compiler infrastructure for model deployment workflows.

Snowgoose provides access to models from OpenAI, Anthropic, Google, and other providers in one AI workspace.

Semantic Cache Router presents a distributed semantic cache and stateful routing system.