PromptSite provides prompt version management for tracking, experimentation, and debugging LLM prompts.
Open source
24 alternativesMLflow
MLflow helps teams build AI products by debugging, evaluating, monitoring, and improving AI applications.
About MLflow
MLflow is an open source platform for building, debugging, evaluating, monitoring, and improving AI applications, including LLM applications, agents, and traditional machine learning models. It captures traces of LLM and agent behavior using OpenTelemetry, runs systematic evaluations with built-in metrics and LLM judges, versions and optimizes prompts, and provides an OpenAI-compatible gateway for routing requests across LLM providers. An Agent Server offers FastAPI-based hosting with request validation, streaming, and built-in tracing.
The project is published under the Apache 2.0 license, is backed by the Linux Foundation, and is hosted on GitHub. The homepage states support for Python, TypeScript/JavaScript, Java, and R, and integrations with more than 100 tools. Typical setup starts a local MLflow server and adds logging code to an existing application. No pricing details are listed on the homepage, and the source does not describe geographic eligibility restrictions.
Key features
- Capture full traces of LLM apps and agents via OpenTelemetry
- Run evaluations with 50+ built-in metrics and LLM judges
- AI-powered analysis of correctness, latency, execution, relevance and safety
- Version, test and deploy prompts with lineage tracking and optimization algorithms
- OpenAI-compatible AI gateway for routing, rate limits and fallbacks
- FastAPI-based Agent Server with request validation, streaming and tracing
Best for: Teams building and operating LLM, agent, or machine learning applications that want an open source platform for tracing, evaluation, prompt management, and monitoring.
Good for
- Open source under the Apache 2.0 license, backed by the Linux Foundation
- Integrates with 100+ tools and supports Python, TypeScript/JavaScript, Java, and R
- Works with any cloud, framework, or tool according to the site, with no vendor lock-in
Watch out for
- No pricing information is provided on the homepage
- The homepage does not describe hosted or managed service tiers
MLflow at a glance
- Website
- mlflow.org
- Type
- Online tool
- Pricing
- Not confirmed. Check the site
- Platforms
- Web
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 5, 2026 · Online when checked
- Listed
- Oct 5, 2026
MLflow alternatives
Tools and sites you could use instead, ranked by how closely they match.
Valohai provides MLOps tools for comparing, evaluating, and shipping configurations for AI products using specialized models.
Confident AI provides evaluation, observability, red-teaming, and governance tools for testing and monitoring AI systems.
Deepchecks evaluates and monitors AI agents using testing, tracing, dataset scoring, and production observability tools.
DeepEval is an LLM evaluation framework, according to its repository description.
Open source
24 alternatives
The abso TypeScript SDK calls more than 100 LLM providers through an OpenAI compatible format.
Open source
24 alternativesPopular in AI Infrastructure & MLOps
Well-known listings from the same topic.
Guild AIguild.aiFlow AIflow-ai.comsystemprompt.iosystemprompt.ioKili Technologykili-technology.comAPI docsdocs.x.aiEyePop.aieyepop.ai
MLflow FAQ
What is MLflow?
It is described as an open source AI engineering platform for agents, LLMs, and ML models that lets teams debug, evaluate, monitor, and optimize production-quality AI applications while managing costs and access to models and data.
How do you get started with MLflow?
The homepage lists three steps: start an MLflow server (for example with the uvx mlflow server command; Docker setup is also available), add minimal logging code such as setting a tracking URI and enabling autolog, then run your code and explore traces and metrics in the MLflow UI.
What license does MLflow use?
MLflow is fully open source under the Apache 2.0 license and is backed by the Linux Foundation, according to the homepage.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.