Leonie Monigatti on LinkedIn: 4 tutorials that helped me learn LLM fine-tuning in 3 weeks: 1. “How to… | 18 comments

Leonie Monigatti on LinkedIn: 4 tutorials that helped me learn LLM fine-tuning in 3 weeks: 1. “How to… | 18 comments

Leonie Monigatti linkedin.com

RelatedHighlights

AI for Training - the evolution of corporate training

Brighteye Ventures Fund brighteyevc.com

Thumbnail of AI for Training - the evolution of corporate training

Sign Up | LinkedIn

Learn 80% of NotebookLM in Under 13 Minutes!

2-5x faster 50% less memory local LLM finetuning

Manual autograd engine - hand derived backprop steps.

2x to 5x faster than QLoRA. 50% less memory usage.

All kernels written in OpenAI's Triton language.

0% loss in accuracy - no approximation methods - all exact.

No change of hardware necessary. Supports NVIDIA GPUs since 2018+. Minimum CUDA Compute Cap

... See more

unslothai • GitHub - unslothai/unsloth: 5X faster 50% less memory LLM finetuning

Evidence that LLMs are reaching a point of diminishing returns - and what that might mean

Gary Marcus garymarcus.substack.com

Thumbnail of Evidence that LLMs are reaching a point of diminishing returns - and what that might mean