Playground for devs to finetune & deploy LLMs

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

A method designed to enhance the efficiency of Transformer models

Simple API for deploying any RAG or LLM that you want adding plugins.

A high-throughput and memory-efficient inference and serving engine for LLMs.