A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.

Use ChatGPT On Wechat via wechaty

SGLang is a fast serving framework for large language models and vision language models.

Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

Nvidia Framework for LLM Inference

A Device-Inference framework, including LLM Inference on device(Mobile Phone/PC/IOT)