a benchmark evaluating QA methods that operate over a mixture of heterogeneous input sources (KB, text, tables, infoboxes).

a ground-truth-based dynamic benchmark derived from off-the-shelf benchmark mixtures, which evaluates LLMs with a highly capable model ranking while running locally and quickly.

a Swedish language understanding benchmark that evaluates natural language processing (NLP) models on various tasks such as argumentation analysis, semantic similarity, and textual entailment.

A Challenging, Contamination-Free LLM Benchmark.

a benchmark for evaluating AI models across multiple academic disciplines like math, physics, chemistry, biology, and more.

focuses on understanding how these models perform in various scenarios and analyzing results from an interpretability perspective.