so a few days ago, i finally read the legendary "attention is all you need" paper 🤓
always knew about it, but went full deep dive this time (haha small ss of notes📝)
got curious about where the authors are now and what they’re up to 👀
so here we are with a... See more
i've been trying to understand the transformer architecture for ages but it never clicked. so recently i started trying to learn its history and that has helped a LOT. to try to cement what i learned imma write up a essay.
Undefined Behavior presents: The Evolution of Attention