Deepchecks evaluates and monitors AI agents using testing, tracing, dataset scoring, and production observability tools.
Galileo
Galileo evaluates, monitors, and protects generative AI applications through observability tools for AI teams.
About Galileo
Galileo is an AI observability and evaluation platform for generative AI applications, including RAG systems and agents. It supports building datasets from synthetic, development, and live production data with subject matter expert annotations, and provides out-of-box evals for RAG, agents, safety, and security alongside custom evaluators.
Eval metrics can be tuned from live feedback, and optimized evals can be distilled into Luna models for production monitoring. Eval scores can be used to control agent actions, tool access, and escalation paths through guardrail policies. Deployment is available as SaaS, Virtual Private Cloud, or on-premises.
Key features
- Build datasets from synthetic, development, and live production data
- Auto-tune eval metrics from live feedback
- Out-of-box evals for RAG, agents, safety, and security
- Custom evaluators to encode domain expertise
- Distill evals into Luna models for production monitoring
- Guardrail policies controlling agent actions and escalation paths
Best for: AI teams building and operating RAG systems and agents that need evaluation and production monitoring.
Good for
- Supports SaaS, Virtual Private Cloud, and on-premises deployment
- Includes out-of-box evals for RAG, agents, safety, and security plus custom evaluators
- Links pre-production evals to production guardrail policies
Galileo at a glance
- Website
- galileo.ai
- Type
- Website
- Pricing
- Not confirmed. Check the site
- Platforms
- Web
- Open source
- Not stated
- Language
- English
- Last checked
- Oct 5, 2026 · Online when checked
- Listed
- Oct 5, 2026
Galileo alternatives
Tools and sites you could use instead, ranked by how closely they match.
Confident AI provides evaluation, observability, red-teaming, and governance tools for testing and monitoring AI systems.
Comet's Opik platform provides AI observability, agent testing, evaluation, and monitoring for developers.
Respan unifies LLM observability, evals, prompt optimization, and an AI gateway so teams can ship reliable AI applications.
Guardrails AI provides a framework for building, governing, and deploying reliability controls for generative AI systems.
TensorZero builds open-source tools for production-grade LLM applications: LLM gateway, observability, optimization, evaluations, and experimentation.
Popular in AI Infrastructure & MLOps
Well-known listings from the same topic.
Guild AIguild.aiFlow AIflow-ai.comsystemprompt.iosystemprompt.ioCoreWeavecoreweave.comKili Technologykili-technology.comAPI docsdocs.x.ai
Galileo FAQ
What evaluation types are covered?
RAG, agent, safety, and security evals, with 20+ out-of-box evals and support for custom evaluators.
What deployment options are available?
SaaS, Virtual Private Cloud, and on-premises.
How are evals used in production?
Optimized evals are distilled into Luna models for monitoring, and eval scores control agent actions, tool access, and escalation paths.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.