Playground for devs to finetune & deploy LLMs

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

Lightweight alternative to LangChain for composing LLMs

Comprehensive set of tools for working with local LLMs for various tasks.