MindSQL | LLMWay – The Way To LLM

Inference Engines

MindSQL

A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.

GitHub

A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.

Floom 41

AI gateway and marketplace for developers, enables streamlined integration of AI features into products

magentic 2,224

Seamlessly integrate LLMs as Python functions

LMDeploy 5,838

A high-throughput and low-latency inference and serving framework for LLMs and VLs

MNN-LLM 10,008

A Device-Inference framework, including LLM Inference on device(Mobile Phone/PC/IOT)

Agenta 2,209

Easily build, version, evaluate and deploy your LLM-powered apps.

LiteChain 415

Lightweight alternative to LangChain for composing LLMs