a benchmark for evaluating the performance of large language models (LLMs) in various tasks related to both textual and visual imagination.

An Automatic Evaluator for Instruction-following Language Models using Nous benchmark suite.

a ground-truth-based dynamic benchmark derived from off-the-shelf benchmark mixtures, which evaluates LLMs with a highly capable model ranking while running locally and quickly.

benchmark designed to evaluate large language models (LLMs) on solving complex, college-level scientific problems from domains like chemistry, physics, and mathematics.

a benchmark for evaluating AI models across multiple academic disciplines like math, physics, chemistry, biology, and more.

a benchmark dataset testing AI's ability to reason about visual commonsense through images that defy normal expectations.