MixEval | LLMWay – The Way To LLM

Evaluation

MixEval

A reliable click-and-go evaluation suite compatible with both open-source and proprietary models, supporting MixEval and other benchmarks.

GitHub

A reliable click-and-go evaluation suite compatible with both open-source and proprietary models, supporting MixEval and other benchmarks.

a unified platform from LangChain framework for: evaluation, collaboration HITL (Human In The Loop), logging and monitoring LLM applications.

simple-evals 3,695

Eval tools by OpenAI.

lm-evaluation-harness 9,284

A framework for few-shot evaluation of language models.

Giskard 4,631

Testing & evaluation library for LLM applications, in particular RAGs

lighteval 1,622

a lightweight LLM evaluation suite that Hugging Face has been using internally.

OLMO-eval 349

a repository for evaluating open language models.