AI Infrastructure & MLOps

Curated list of awesome vector search framework/engine, library, cloud service and research papers to vector similarity search.

This Docker-based starter kit provides a runtime for machine learning work in Jupyter notebooks.

Tilores resolves and deduplicates customer records using fuzzy matching to unify scattered data in real time.

Unsloth Studio provides a local workspace for running and training AI models.

PyTorch TNT supplies lightweight tools and utilities for training with PyTorch.

PAI schedules resources and manages clusters for AI workloads across distributed computing environments.

PyTorch Ignite provides a high level library for flexibly training and evaluating neural networks.

Maze provides an applied reinforcement learning framework for developing projects in Python.

BentoML helps build and serve AI apps and models through inference APIs, job queues, and multi-model pipelines.

Monkt converts PDFs, Word, PowerPoint, Excel, CSV, webpages, and HTML into Markdown or structured JSON.

Curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning.

TensorRT-LLM provides Python and C++ runtimes with optimizations for language model inference on NVIDIA GPUs.

PromptLayer supports prompt versioning, LLM evaluations, and production monitoring with traces, logs, and regression sets.

DeepSeek’s API documentation lists pricing and capabilities for its DeepSeek-V4-Flash model.

Extensible Toolkit for Finetuning and Inference of Large Foundation Models.

NannyML provides Python tools for post-deployment data science and monitoring model performance under data drift.

PrimeHub offers an open-source platform for managing machine learning operations and workflows.

CML provides continuous machine learning and CI/CD workflows for machine learning projects.

ChatComparison lets users compare responses from more than 40 AI models side by side using the same prompt.

Laminar provides open-source observability tools designed for applications built with AI agents.

Latitude provides observability for AI agents and helps teams trace failures and verify fixes.

MMDeploy provides a model deployment framework from the OpenMMLab project.

Labelbox provides data and simulated environments for training AI systems and deploying agents across business applications.

Talos provides tools for running hyperparameter experiments with TensorFlow and Keras.