Use ChatGPT On Wechat via wechaty

Open Source LLM Engineering Platform 🪢 Tracing, Evaluations, Prompt Management, Evaluations and Playground.

Fine-tune, serve, deploy, and monitor any open-source LLMs in production. Used in production at BentoML for LLMs-based applications.

Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.

Lightweight alternative to LangChain for composing LLMs

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.