AI Infrastructure

The colibri-core NLP tool and library works with n-grams, skipgrams, and other linguistic patterns.

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

This repository contains utilities intended for use with Llama models.

NVIDIA NIM offers APIs for trying models used to build enterprise generative AI applications.

Guild helps engineering teams manage, govern, and share deployed AI agents.

Gymnasium provides a standard API for single agent reinforcement learning environments and related utilities.

DeepEval is an LLM evaluation framework, according to its repository description.

Flow AI provides data-agent infrastructure with a catalog and typed plans for building analytical agents over data products.

Kubeflow Pipelines orchestrates and manages machine learning workflows on Kubeflow.

Galaxy invests across digital assets and AI data centers, with pages covering asset management, custody, infrastructure, and market research.

systemprompt.io governs connected AI clients, models, and tools with access policies and audit on user infrastructure.

Kili Technology provides annotation tools for building datasets to train, fine-tune, and evaluate AI models.

The abso TypeScript SDK calls more than 100 LLM providers through an OpenAI compatible format.

SpaceXAI’s Grok API documentation covers chat, image and video generation, voice, and structured outputs.

Evidently evaluates, tests, and monitors machine learning systems and data pipelines.

EyePop.ai lets teams train and deploy custom AI detection for people, vehicles, and behavior using existing cameras and video systems.

Listen to Chain of Thought, a podcast on AI infrastructure, agent systems, and evaluations.

A library for efficient similarity search and clustering of dense vectors.

Vast.ai lets users rent cloud GPUs for AI, machine learning, deep learning, and rendering workloads.

Weco describes itself as a research and product lab working on recursively self-improving AI.

Prime Intellect provides compute, training, inference, and sandbox tools for training and deploying machine learning models.

Tensorforce provides a TensorFlow library for applied reinforcement learning tasks.

Torchvision provides datasets, transforms, and models for computer vision with PyTorch.

Hugging Face Text Embeddings Inference serves text embedding models through an inference solution.