Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.

Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

A high-throughput and low-latency inference and serving framework for LLMs and VLs

Run LLMs and batch jobs on any cloud. Get maximum cost savings, highest GPU availability, and managed execution -- all with a simple interface.

Seamlessly integrate LLMs as Python functions

Formerly langchain-ChatGLM, local knowledge based LLM (like ChatGLM) QA app with langchain.