Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Open source
24 alternativesHow do Cornac and WhichLLM compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | Cornac | WhichLLM |
|---|---|---|
| What it is | Cornac provides a framework for comparing multimodal recommender systems and recommendation algorithms. | WhichLLM tests local language models on a user’s hardware and ranks them using recent benchmarks. |
| Website | ||
| Type | Open-source project | Open-source project |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Not recorded | Not recorded |
| Open source | Yes | Yes |
| Language | English | English |
| Alternatives |
Sites similar to both Cornac and WhichLLM.
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Giskard provides open source evaluation and testing tools for LLM agents.
NALP covers Natural Adversarial Language Processing through a dedicated library.
Captum explains model behavior and supports interpretability analysis for PyTorch systems.
pytorch tabular provides a unified framework for deep learning models on tabular data.
AIF360 provides fairness metrics and explanations for datasets and models, along with algorithms to mitigate bias.