Easily build, version, evaluate and deploy your LLM-powered apps.

Simple API for deploying any RAG or LLM that you want adding plugins.

Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

A Device-Inference framework, including LLM Inference on device(Mobile Phone/PC/IOT)

Playground for devs to finetune & deploy LLMs

A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.