MixEval | LLMWay – The Way To LLM

Evaluation

MixEval

A reliable click-and-go evaluation suite compatible with both open-source and proprietary models, supporting MixEval and other benchmarks.

GitHub

A reliable click-and-go evaluation suite compatible with both open-source and proprietary models, supporting MixEval and other benchmarks.

Giskard 4,503

Testing & evaluation library for LLM applications, in particular RAGs

simple-evals 2,755

Eval tools by OpenAI.

OLMO-eval 347

a repository for evaluating open language models.

lighteval 1,482

a lightweight LLM evaluation suite that Hugging Face has been using internally.

instruct-eval 546

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

Ragas 9,005

a framework that helps you evaluate your Retrieval Augmented Generation (RAG) pipelines.