Locally running websearch using LLM chains

a chat interface crafted with llama.cpp for running Alpaca models. No API keys, entirely self-hosted!

A high-throughput and memory-efficient inference and serving engine for LLMs.

Use ChatGPT On Wechat via wechaty

Fine-tune, serve, deploy, and monitor any open-source LLMs in production. Used in production at BentoML for LLMs-based applications.

Create, deploy and operate Actions using Python anywhere to enhance your AI agents and assistants. Batteries included with an extensive set of libraries, helpers and logging.