a benchmark that evaluates large language models on a variety of multimodal reasoning tasks, including language, natural and social sciences, physical and social commonsense, temporal reasoning, algebra, and geometry.

A Challenging, Contamination-Free LLM Benchmark.

a benchmark designed to evaluate large language models (LLMs) specifically in their ability to answer real-world coding-related questions.

a meta-benchmark that evaluates how well factuality evaluators assess the outputs of large language models (LLMs).

a benchmark dataset testing AI's ability to reason about visual commonsense through images that defy normal expectations.

a benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner.