Get up and running with Llama 3, Mistral, Gemma, and other large language models.

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

Seamlessly integrate LLMs as Python functions

AI gateway and marketplace for developers, enables streamlined integration of AI features into products

Lightweight alternative to LangChain for composing LLMs

an open-source NLP framework that allows you to use LLMs and transformer-based models from Hugging Face, OpenAI and Cohere to interact with your own data.