How to understand Github code repos with LLMs in 2 mins. Even after 10yrs of engineering, dissecting a large codebase is daunting. 1 Dump the code into one big file 2 Feed it to Gemini-1.5Pro (2M context) 3 Ask it anything. Here's, I dissect... See more

Llama 3 from scratch. Might have been written by @sama https://t.co/QYkkMkV5bq

📽️ New 4 hour (lol) video lecture on YouTube: "Let’s reproduce GPT-2 (124M)" https://t.co/QTUdu8b0qh The video ended up so long because it is... comprehensive: we start with empty file and end up with a GPT-2 (124M) model: - first we build the GPT-2 network - then... See more