GitHub - predibase/lorax: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Want to train a specialized LLM on your own data? The easiest way to do this is with low rank adaptation (LoRA), but many variants of LoRA exist. Here’s an overview of all (or at least most) of the techniques that are out there…
LoRA models the update derived for a model’s weights during finetuning with a low rank... See more

