Use ChatGPT On Wechat via wechaty

Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

Locally running websearch using LLM chains

SGLang is a fast serving framework for large language models and vision language models.

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

Nvidia Framework for LLM Inference