a benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner.

A pioneering benchmark specifically designed to assess honesty in LLMs comprehensively.

a multimodal question-answering benchmark designed to evaluate AI models' cognitive ability to understand human beliefs and goals.

a benchmark that evaluates large language models on a variety of multimodal reasoning tasks, including language, natural and social sciences, physical and social commonsense, temporal reasoning, algebra, and geometry.

a meta-benchmark that evaluates how well factuality evaluators assess the outputs of large language models (LLMs).

CompassRank is dedicated to exploring the most advanced language and visual models, offering a comprehensive, objective, and neutral evaluation reference for the industry and research.