MLflow vs lunary-ai/abso

Glide provides an open model gateway for developing production generative AI applications.

Ollama runs language models locally and provides tools to work with model files and APIs.

Confident AI provides evaluation, observability, red-teaming, and governance tools for testing and monitoring AI systems.

Stakpak runs an agent on a machine to ship code and keep applications running.

Hugging Face Text Embeddings Inference serves text embedding models through an inference solution.

OpenModelZ scales LLM inference on Kubernetes with engines including vLLM, SGLang, and LMDeploy.