Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.

MII makes low-latency and high-throughput inference, similar to vLLM powered by DeepSpeed.

a toolkit for deploying and serving Large Language Models (LLMs).

Create, deploy and operate Actions using Python anywhere to enhance your AI agents and assistants. Batteries included with an extensive set of libraries, helpers and logging.

Use ChatGPT On Wechat via wechaty

An interactive chat project that leverages Ollama/OpenAI/MistralAI LLMs for rapid understanding and navigation of GitHub code repository or compressed file resources.