a benchmark designed to evaluate large language models (LLMs) specifically in their ability to answer real-world coding-related questions.

benchmark designed to evaluate large language models (LLMs) on solving complex, college-level scientific problems from domains like chemistry, physics, and mathematics.

a benchmark that evaluates large multimodal models (LMMs) on their ability to perform human-like mathematical reasoning.

evaluates LLM's ability to call external functions/tools.

A Challenging, Contamination-Free LLM Benchmark.

a benchmark designed to assess the performance of multimodal web agents on realistic visually grounded tasks.