GitHub - Lightning-AI/litgpt: Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
Lightning-AIgithub.com
GitHub - Lightning-AI/litgpt: Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
Nice paper for a long read across 114 pages.
"Ultimate Guide to Fine-Tuning LLMs"
Some of the things they cover
📊 Fine-tuning Pipeline
Outlines a seven-stage process for fine-tuning LLMs, from data preparation to deployment and... See more
This is truly the AI Engineer's TOOLKIT you need:
A list of 120+ libraries and frameworks categorized by application. When starting a new project (training, agentrs, RAG, etc.) you can just check out the available libraries and make sure you're working with the best one. https://t.co/5TsqWFGX9J
