a benchmark platform designed for evaluating large language models (LLMs) on a range of tasks, particularly focusing on their performance in different aspects such as natural language understanding, reasoning, and generalization.

evaluates LLM's ability to call external functions/tools.

a benchmark dataset testing AI's ability to reason about visual commonsense through images that defy normal expectations.

a benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner.

a ground-truth-based dynamic benchmark derived from off-the-shelf benchmark mixtures, which evaluates LLMs with a highly capable model ranking while running locally and quickly.

benchmark designed to evaluate large language models (LLMs) on solving complex, college-level scientific problems from domains like chemistry, physics, and mathematics.