Eval tools by OpenAI.

A reliable click-and-go evaluation suite compatible with both open-source and proprietary models, supporting MixEval and other benchmarks.

a framework that helps you evaluate your Retrieval Augmented Generation (RAG) pipelines.

a lightweight LLM evaluation suite that Hugging Face has been using internally.

A framework for few-shot evaluation of language models.

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.