GitHub - predibase/lorax: Multi-LoRA inference server that s...

GitHub - predibase/lorax: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

predibase github.com

RelatedInsightsHighlights

Thumbnail of www-x-com-tom-doerr-status-1884105902766092724-50f50334729d416c

AI model serving engine on FastAPI https://t.co/4YArLydsAK

Tom Dörr

x.com

alpaca-lora: Code for reproducing the Stanford Alpaca InstructLLaMA result on consumer hardware github: https://t.co/NB6nrDXV48 https://t.co/RL2AwwbNt3

x.com

Baseten | Machine learning infrastructure

baseten.co