instruct-eval | LLMWay – The Way To LLM

Evaluation

instruct-eval

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

GitHub

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

OLMO-eval 349

a repository for evaluating open language models.

lm-evaluation-harness 9,284

A framework for few-shot evaluation of language models.

Ragas 9,518

a framework that helps you evaluate your Retrieval Augmented Generation (RAG) pipelines.

Giskard 4,631

Testing & evaluation library for LLM applications, in particular RAGs

MixEval 242

A reliable click-and-go evaluation suite compatible with both open-source and proprietary models, supporting MixEval and other benchmarks.

simple-evals 3,695

Eval tools by OpenAI.