Easily build, version, evaluate and deploy your LLM-powered apps.

A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

Framework to create ChatGPT like bots over your dataset.

Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

Harness LLMs with Multi-Agent Programming