Sublime

New 3h31m video on YouTube: "Deep Dive into LLMs like ChatGPT" This is a general audience deep dive into the Large Language Model (LLM) AI technology that powers ChatGPT and related products. It is covers the full training stack of how the models are developed, along with mental models of how to think abou... See more

AI crash course repository https://t.co/ShNM4QDQbG

Curating high-quality posts from AI Twitter with my own take, Vol. 2 No breaking news, no productivity hack, no insane moments. Just some solid stuff that makes AI a bit better than last week. Time for Chef's pick. Here we go: https://t.co/KkVE1B8szK

BadMephisto also gave this trick https://t.co/XiLH25aSGZ

📽️ New 4 hour (lol) video lecture on YouTube: "Let’s reproduce GPT-2 (124M)" https://t.co/QTUdu8b0qh The video ended up so long because it is... comprehensive: we start with empty file and end up with a GPT-2 (124M) model: - first we build the GPT-2 network - then we optimize it to train very fast - then we set up the training run optimization and hyperparameters by referencing GPT-2 and GPT-3 papers - then we bring up model evaluation, and - then cross our fingers and go to sleep. In the morning we look through the results and enjoy amusing model generations. Our "overnight" run even gets very close to the GPT-3 (124M) model. This video builds on the Zero To Hero series and at times references previous videos. You could also see this video as building my nanoGPT repo, which by the end is about 90% similar. Github. The associated GitHub repo contains the full commit history so you can step through all of the code changes in the video, step by step. https://t.co/BOzkxQ8at2 Chapters. On... See more