a toolkit for deploying and serving Large Language Models (LLMs).
Fine-tune, serve, deploy, and monitor any open-source LLMs in production. Used in production at BentoML for LLMs-based applications.
A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.
Inference for text-embeddings in Rust, HFOIL Licence.
Easily build, version, evaluate and deploy your LLM-powered apps.
Get up and running with Llama 3, Mistral, Gemma, and other large language models.
Playground for devs to finetune & deploy LLMs
Your email address will not be published. Required fields are marked *
Comment *
Name *
Email *
Website
Captcha: 10 - 13 = ?*
Save my name, email, and website in this browser for the next time I comment.
Fine-tune, serve, deploy, and monitor any open-source LLMs in production. Used in production at BentoML for LLMs-based applications.