AI Infrastructure & MLOps

The colibri-core NLP tool and library works with n-grams, skipgrams, and other linguistic patterns.

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

This repository contains utilities intended for use with Llama models.

NVIDIA NIM offers APIs for trying models used to build enterprise generative AI applications.

Guild helps engineering teams manage, govern, and share deployed AI agents.

Gymnasium provides a standard API for single agent reinforcement learning environments and related utilities.

DeepEval is an LLM evaluation framework.

Flow AI provides data-agent infrastructure with a catalog and typed plans for building analytical agents over data products.

Kubeflow Pipelines orchestrates and manages machine learning workflows on Kubeflow.

systemprompt.io governs connected AI clients, models, and tools with access policies and audit on user infrastructure.

CoreWeave presents cloud infrastructure for AI and machine learning, with deployment and scaling for production models.

Kili Technology provides annotation tools for building datasets to train, fine-tune, and evaluate AI models.

The abso TypeScript SDK calls more than 100 LLM providers through an OpenAI compatible format.

SpaceXAI’s Grok API documentation covers chat, image and video generation, voice, and structured outputs.

Evidently evaluates, tests, and monitors machine learning systems and data pipelines.

EyePop.ai lets teams train and deploy custom AI detection for people, vehicles, and behavior using existing cameras and video systems.

A library for efficient similarity search and clustering of dense vectors.

Ollama runs language models locally and provides tools to work with model files and APIs.

Weco describes itself as a research and product lab working on recursively self-improving AI.

Prime Intellect provides compute, training, inference, and sandbox tools for training and deploying machine learning models.

fal gives developers access to generative image, video, 3D, and audio models through a single platform.

Tensorforce provides a TensorFlow library for applied reinforcement learning tasks.

Torchvision provides datasets, transforms, and models for computer vision with PyTorch.

Hugging Face Text Embeddings Inference serves text embedding models through an inference solution.