Comprehensive set of tools for working with local LLMs for various tasks.

simplifies the evaluation of LLMs by providing a unified microservice to access and test multiple AI models.

Playground for devs to finetune & deploy LLMs

Inference for text-embeddings in Rust, HFOIL Licence.

First LLM Multi-agent framework.

Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.