WhichLLM tests local language models on a user’s hardware and ranks them using recent benchmarks.
Open source
24 alternativesAider LLM Leaderboards
Aider LLM Leaderboards compares language models on code editing benchmarks.
About Aider LLM Leaderboards
Aider LLM Leaderboards compares large language models on code editing. It uses Aider's polyglot benchmark, which tests models on 225 Exercism coding exercises across C++, Go, Java, JavaScript, Python, and Rust. The benchmark measures how well a model follows instructions and edits code successfully without human intervention.
Each model run is listed with its percent correct, cost, command, and edit format. Detail views add pass rates, malformed response counts, error types, token counts, run dates, and Aider version numbers. The results apply to the specific runs shown, and the page does not state pricing for the leaderboard itself.
Key features
- Polyglot benchmark of 225 Exercism exercises across six programming languages
- Leaderboard listing percent correct, cost, command, and edit format for each model run
- Detail view with pass rates, test case counts, and malformed response counts
- Error breakdown including syntax errors, indentation errors, and test timeouts
- Run metadata including date, Aider version, commit hash, and reasoning effort setting
- Token counts, seconds per case, and total cost recorded for each run
Best for: Developers and researchers who want to compare language models on code editing tasks using per-run accuracy, cost, and configuration details.
Good for
- Each result records the exact command, edit format, date, and Aider version used.
- A single benchmark covers six programming languages.
- Accuracy results appear alongside cost and token usage for each run.
Watch out for
- The benchmark is built from Exercism coding exercises, and the page does not state how results carry over to other kinds of coding work.
Aider LLM Leaderboards at a glance
- Website
- aider.chat/docs/leaderboards
- Category
- AI & Machine Learning › AI Data & Analytics
- Type
- Website
- Pricing
- Not confirmed. Check the site
- Platforms
- Web, Windows
- Open source
- Not stated
- Language
- English
- Last checked
- Oct 6, 2026 · Online when checked
- Listed
- Oct 5, 2026
Aider LLM Leaderboards alternatives
Tools and sites you could use instead, ranked by how closely they match.
LLMeBench provides a flexible framework for benchmarking large language models.
OpenLM Arena compares open language models through leaderboards and benchmark results.
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Open source
24 alternatives
Deploybase compares GPU cloud and language model API prices, performance benchmarks, and provider market data.
AwaDB provides an AI-focused embedding vector database with real-time search features.
Open source
24 alternativesPopular in AI Data & Analytics
Well-known listings from the same topic.
Dotgetdot.aiForvioforvio.comFluidAI Medicalfluidai.mdApache Zeppelinzeppelin.apache.orgSola Securitysola.securityQuadraticquadratichq.com
Aider LLM Leaderboards FAQ
Which programming languages does the polyglot benchmark cover?
The polyglot benchmark tests models on 225 Exercism coding exercises across C++, Go, Java, JavaScript, Python, and Rust.
What does the benchmark measure?
It evaluates an LLM's ability to follow instructions and edit code successfully without human intervention.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.