An Automatic Evaluator for Instruction-following Language Models using Nous benchmark suite.

aims to track, rank, and evaluate LLMs and chatbots as they are released.

evaluates LLM's ability to call external functions/tools.

a benchmark that evaluates large language models on a variety of multimodal reasoning tasks, including language, natural and social sciences, physical and social commonsense, temporal reasoning, algebra, and geometry.

a biomedical question-answering benchmark designed for answering research-related questions using PubMed abstracts.

a Swedish language understanding benchmark that evaluates natural language processing (NLP) models on various tasks such as argumentation analysis, semantic similarity, and textual entailment.