OpenRouter publishes language model rankings based on real usage through its API.
LLM Testing Guide
vsPricePerToken
LLM Testing Guide vs PricePerToken
How do LLM Testing Guide and PricePerToken compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | LLM Testing Guide | PricePerToken |
|---|---|---|
| What it is | A free downloadable guide covering strategies for testing large language models and analyzing their behavior. | PricePerToken compares API costs for language models from multiple providers. |
| Website | ||
| Type | Website | Website |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Web | Web |
| Open source | Not stated | Not stated |
| Language | English | — |
| Alternatives |
Other options to consider
Sites similar to both LLM Testing Guide and PricePerToken.
LifeArchitect publishes a reference table of language models and their specifications and data points.
Deploybase compares GPU cloud and language model API prices, performance benchmarks, and provider market data.
SimpleBench evaluates everyday reasoning by comparing language models with human performance.
Countless.dev compares AI models, prices, and features through a pricing calculator.
Calculate language model API costs using input, cached input, and output token counts.