How to Fine-Tune LLMs in 2024 with Hugging Face
What's the best way to fine-tune open LLMs in 2024? Look no further! 👀 I am excited to share “How to Fine-Tune LLMs in 2024 with Hugging Face” using the latest research techniques, including Flash Attention, Q-LoRA, @OpenAI dataset formats (messages), ChatML, Packing, all built with @huggingface TRL. 🚀
It is created... See more
Philipp Schmidx.com
Nice paper for a long read across 114 pages.
"Ultimate Guide to Fine-Tuning LLMs"
Some of the things they cover
📊 Fine-tuning Pipeline
Outlines a seven-stage process for fine-tuning LLMs, from data preparation to deployment and... See more