Langchain-Chatchat | LLMWay

Inference Engines

Langchain-Chatchat

Formerly langchain-ChatGLM, local knowledge based LLM (like ChatGLM) QA app with langchain.

GitHub

Formerly langchain-ChatGLM, local knowledge based LLM (like ChatGLM) QA app with langchain.

MindSQL 402

A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.

Wllama 770

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

Flash-Attention 18,393

A method designed to enhance the efficiency of Transformer models

Langfuse 13,757

Open Source LLM Engineering Platform 🪢 Tracing, Evaluations, Prompt Management, Evaluations and Playground.

GPUStack 3,082

An open-source GPU cluster manager for running LLMs