promptfoo tests prompts, agents, and retrieval systems with evaluations and security testing.
Open source
16 alternativesLangWatch
LangWatch provides evaluations for language models and tests for AI agent applications.
About LangWatch
LangWatch is an open-source platform for observing and testing language model use in production. It traces LLM calls, runs agent testing and evaluations, manages prompts, and tracks coding assistant sessions with cost reporting per pull request and team. It provides a cloud option and self-hosting with Node.js, plus an OpenAI and Anthropic compatible gateway with virtual keys, budgets and routing. Enterprise modules under platform/app/ee/ require a commercial license in production.
Key features
- Trace LLM calls and agent sessions with cost tracking per PR and team
- Create simulation tests for agents and voice agents
- Manage prompts with evaluations and observability
- Route requests via OpenAI and Anthropic compatible AI gateway
- Create virtual keys with budgets for customers or employees
- Monitor AI tool usage with anomaly rules for governance
Best for: AI platform teams managing agents and coding assistants in production.
Good for
- Open source under Apache 2.0 with MIT-licensed SDKs
- Supports self-hosting with only Node.js required
- Integrates with multiple frameworks, model providers and coding assistants
Watch out for
- Enterprise modules under platform/app/ee/ need a commercial license in production
LangWatch at a glance
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 6, 2026 · Online when checked
- Listed
- Oct 5, 2026
LangWatch alternatives
Tools and sites you could use instead, ranked by how closely they match.
LangKit monitors language model prompts and responses and extracts signals related to safety and security.
Open source
EvalView regression tests AI agents by snapshotting behavior and comparing tool calls in CI.
Open source
17 alternatives
rehydra scans LLM prompts for accidental personal information before they reach a model.
Open source
17 alternatives
Cleanlab Detect scores AI responses for trust and accuracy and flags issues such as hallucinations or missing context.
OpenCodeReview combines deterministic checks and language model agents for code review with line-level comments.
Open source
17 alternativesPopular in AI Code Review & Testing
Well-known listings from the same topic.
Prediction Guardpredictionguard.comGreptilegreptile.comGitAutogitauto.aipromptfoopromptfoo.devRefractionrefraction.devKatalonkatalon.com
LangWatch FAQ
Can LangWatch be self-hosted?
Yes, via npx @langwatch/server with only Node.js required; production use follows separate self-hosting guidance.
Which license does LangWatch use?
Apache 2.0, except enterprise modules under platform/app/ee/ need a commercial license in production, and SDKs are MIT.
How to track coding agents?
Use npx langwatch claude, with support listed for codex, copilot, opencode and others.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.