Locally running websearch using LLM chains

An interactive chat project that leverages Ollama/OpenAI/MistralAI LLMs for rapid understanding and navigation of GitHub code repository or compressed file resources.

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

LLM inference in C/C++.

An open-source GPU cluster manager for running LLMs

Harness LLMs with Multi-Agent Programming