a multimodal question-answering benchmark designed to evaluate AI models' cognitive ability to understand human beliefs and goals.

a biomedical question-answering benchmark designed for answering research-related questions using PubMed abstracts.

a benchmark designed to evaluate large language models (LLMs) specifically in their ability to answer real-world coding-related questions.

a benchmark dataset testing AI's ability to reason about visual commonsense through images that defy normal expectations.

a benchmark that evaluates large multimodal models (LMMs) on their ability to perform human-like mathematical reasoning.

An Automatic Evaluator for Instruction-following Language Models using Nous benchmark suite.