Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

Inference for text-embeddings in Python

Fine-tune, serve, deploy, and monitor any open-source LLMs in production. Used in production at BentoML for LLMs-based applications.

a chat interface crafted with llama.cpp for running Alpaca models. No API keys, entirely self-hosted!

Interact with LLM using Ollama models(or openAI, mistralAI)via pure shell scripts on your Linux(or MacOS) system, enhancing intelligent system management without any dependencies.

Formerly langchain-ChatGLM, local knowledge based LLM (like ChatGLM) QA app with langchain.