Fiddler provides evaluation, monitoring, enforcement, governance, and cost controls for enterprise AI agents.
AgentOps
AgentOps provides tools to trace, debug, and deploy AI agents, with a Python package and engineering resources.
About AgentOps
AgentOps is a web platform plus Python SDK for tracing, debugging and deploying AI agents. It visually tracks events such as LLM calls, tools and multi-agent interactions, supports time travel debugging that rewinds and replays agent runs, and keeps a data trail of logs, errors and prompt injection attacks from prototype to production. It also tracks token counts and cost across multiple agents, and offers fine-tuning of specialized LLMs on saved completions.
Key features
- Visual tracking of LLM calls, tools and multi-agent interactions
- Time travel debugging that rewinds and replays agent runs
- Data trail of logs, errors and prompt injection attacks
- Agent-agnostic SDK with native integrations for agent frameworks
- Token counts and cost tracking across multiple agents
- Fine-tuning of specialized LLMs on saved completions
Best for: Engineering teams that build and operate LLM agents and need tracing, replay debugging and per-agent cost visibility.
Good for
- Free Basic tier available, covering up to 5,000 events
- Agent-agnostic SDK with native integrations for popular agent frameworks
- Enterprise tier lists on-premise deployment, self-hosting on AWS, GCP and Azure, custom SSO and custom data retention
Watch out for
- Free tier is capped at 5,000 events; unlimited event limits and log retention require Pro
- Pro is pay-as-you-go from $40 per month, so costs follow usage
- On-premise and self-hosted deployment options are listed only for Enterprise
AgentOps at a glance
- Website
- agentops.ai
- Category
- AI & Machine Learning › AI Data & Analytics
- Type
- Online tool
- Pricing
- Not confirmed. Check the site
- Platforms
- Web
- Open source
- Not stated
- Language
- English
- Last checked
- Oct 6, 2026 · Online when checked
- Listed
- Oct 5, 2026
AgentOps alternatives
Tools and sites you could use instead, ranked by how closely they match.
This repository catalogs AI models across providers with pricing, context, modality, and capability data.
FreeOpen source
24 alternatives
Manifold provides visual debugging for machine learning models without depending on a specific model type.
Open source
24 alternatives
AgentBench evaluates large language models acting as agents through a research paper and discussion page.
This guide explains LLM evaluation metrics, including measures for retrieval augmented generation and agents, with DeepEval examples.
ccusage analyzes token usage and estimated costs for coding agent command-line tools.
Popular in AI Data & Analytics
Well-known listings from the same topic.
Dotgetdot.aiForvioforvio.comFluidAI Medicalfluidai.mdApache Zeppelinzeppelin.apache.orgSola Securitysola.securityQuadraticquadratichq.com
AgentOps FAQ
How is the AgentOps SDK installed?
The site shows installation with the command 'pip install agentops'.
What does the free Basic plan include?
Basic is $0 per month, free up to 5,000 events, and lists the agent-agnostic SDK, LLM cost tracking for 400+ LLMs, and replay analytics.
What is available in higher tiers?
Pro starts at $40 per month on a pay-as-you-go basis and adds unlimited event limits, unlimited log retention, session and event export, dedicated Slack and email support, and role-based permissioning. Enterprise adds SLA, Slack Connect, custom SSO, on-premise deployment, custom data retention policy, self-hosting on AWS, GCP and Azure, and SOC-2, HIPAA and NIST AI RMF coverage.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.