aims to track, rank, and evaluate LLMs and chatbots as they are released.

a benchmark designed to assess the performance of multimodal web agents on realistic visually grounded tasks.

A benchmark for LLM

benchmark designed to evaluate large language models (LLMs) on solving complex, college-level scientific problems from domains like chemistry, physics, and mathematics.

a benchmark evaluating QA methods that operate over a mixture of heterogeneous input sources (KB, text, tables, infoboxes).

a meta-benchmark that evaluates how well factuality evaluators assess the outputs of large language models (LLMs).