An Automatic Evaluator for Instruction-following Language Models using Nous benchmark suite.

benchmark designed to evaluate large language models (LLMs) on solving complex, college-level scientific problems from domains like chemistry, physics, and mathematics.

A pioneering benchmark specifically designed to assess honesty in LLMs comprehensively.

a biomedical question-answering benchmark designed for answering research-related questions using PubMed abstracts.

aims to track, rank, and evaluate LLMs and chatbots as they are released.

evaluates LLM's ability to call external functions/tools.