An Automatic Evaluator for Instruction-following Language Models using Nous benchmark suite.

a benchmark platform designed for evaluating large language models (LLMs) on a range of tasks, particularly focusing on their performance in different aspects such as natural language understanding, reasoning, and generalization.

a benchmark that evaluates large language models on a variety of multimodal reasoning tasks, including language, natural and social sciences, physical and social commonsense, temporal reasoning, algebra, and geometry.

a comprehensive benchmarking platform designed to evaluate large models' mathematical abilities across 20 fields and nearly 30,000 math problems.

a benchmark designed to evaluate large language models in the legal domain.

a benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner.