CompassRank is dedicated to exploring the most advanced language and visual models, offering a comprehensive, objective, and neutral evaluation reference for the industry and research.

a multimodal question-answering benchmark designed to evaluate AI models' cognitive ability to understand human beliefs and goals.

a meta-benchmark that evaluates how well factuality evaluators assess the outputs of large language models (LLMs).

A Challenging, Contamination-Free LLM Benchmark.

a benchmark designed to evaluate large language models (LLMs) specifically in their ability to answer real-world coding-related questions.

a ground-truth-based dynamic benchmark derived from off-the-shelf benchmark mixtures, which evaluates LLMs with a highly capable model ranking while running locally and quickly.