The Best Fiddler Alternatives in 2026

AgentOps provides tools to trace, debug, and deploy AI agents, with a Python package and engineering resources.

This repository catalogs AI models across providers with pricing, context, modality, and capability data.

ccusage analyzes token usage and estimated costs for coding agent command-line tools.

This guide explains LLM evaluation metrics, including measures for retrieval augmented generation and agents, with DeepEval examples.

Cekura tests voice agents before launch and monitors production conversations for instruction-following, tool calls, and response quality.

Flexor prepares and retrieves unstructured data as context for AI agents, workflows, and enterprise decisions.

Ragas provides an evaluation framework for AI applications, according to its documentation page.

PricePerToken compares API costs for language models from multiple providers.

Calculate language model API costs using input, cached input, and output token counts.

agent-learning-kit provides an evaluation and simulation environment for AI-related workflows.

Uncover LLM evaluation's importance and explore methods for assessing its performance and impact across industries.

Research on evaluation of LLMs conducted by Microsoft Research and other collaborated institutes. (Updated at: 2023/10).

Enkrypt AI provides security and compliance tools to detect threats, remove vulnerabilities, and monitor AI system performance.

AgentBench evaluates large language models acting as agents through a research paper and discussion page.

InterLock proxies AI agent requests to databases, files, and APIs, applying policies, redacting fields, and auditing activity.

AutoRAG helps an agent search for information across files on a computer.

InfraNodus analyzes text with knowledge graphs to reveal themes and gaps across notes, PDFs, surveys, search results, and other data.

UBIAI provides tools for fine-tuning domain-specific language models and developing AI platforms.

Zerve supports research and analytics workflows, with AI agents for data discovery, analysis, reports and production deployment.

MyLens creates narrated, visual presentations from documents, sources, and ideas using AI agents.

Indico benchmarks language models on extractive, classification, and predictive tasks.

SimpleBench evaluates everyday reasoning by comparing language models with human performance.

Deploybase compares GPU cloud and language model API prices, performance benchmarks, and provider market data.

OpenRouter publishes language model rankings based on real usage through its API.