Luc Cheung
@luccheung
Luc Cheung
Self-Attention at a High Level
Don’t be fooled by me throwing around the word “self-attention” like it’s a concept everyone should be familiar with. I had personally never came across the concept until reading the Attention is All You Need paper. Let us distill how it works.
Say the following sentence is an input sentence we want to translate:
” The... See more
Don’t be fooled by me throwing around the word “self-attention” like it’s a concept everyone should be familiar with. I had personally never came across the concept until reading the Attention is All You Need paper. Let us distill how it works.
Say the following sentence is an input sentence we want to translate:
” The... See more
Jay Alammar • The Illustrated Transformer
Jobs' gift is so rare that it's likely even Apple hasn't been able to replace it. It's not a coincidence that the Apple products that frustrate me the most right now are all the ones with "Pro" in the name. The MacBook Pro, with its flawed keyboard and bizarre Touch Bar (I'm still using the old 13" MacBook Pro with the old keyboard, hoping beyond... See more
Remains of the Day • Invisible asymptotes
Anyone can say no to crappy opportunities. Only a master will say no to good opportunities. If you don’t say no to good opportunities, you’ll never have the time to pursue great opportunities.
Saying no is hard. Nobody knew that better than Steve Jobs, who said:
Saying no is hard. Nobody knew that better than Steve Jobs, who said:
People think focus means saying yes to the thing you’ve got to focus on. But that’s not... See more
fs.blog • The Focus to Say No
As you become an adult, you realize that things around you weren't just always there; people made them happen. But only recently have I started to internalize how much tenacity *everything* requires. That hotel, that park, that railway. The world is a museum of passion projects.
John Collisontwitter.com
