Luc Cheung
@luccheung
Luc Cheung
Self-Attention in Detail
Let’s first look at how to calculate self-attention using vectors, then proceed to look at how it’s actually implemented – using matrices.
The first step in calculating self-attention is to create three vectors from each of the encoder’s input vectors (in this case, the embedding of each word). So for each word, we create a... See more
Let’s first look at how to calculate self-attention using vectors, then proceed to look at how it’s actually implemented – using matrices.
The first step in calculating self-attention is to create three vectors from each of the encoder’s input vectors (in this case, the embedding of each word). So for each word, we create a... See more
Jay Alammar • The Illustrated Transformer
All Platforms Have Their Favorite Partners. Be One Of Them If You Can. | SaaStr
Jason Lemkinsaastr.com
Design Thinking Bootleg — Stanford d.school
dschool.stanford.edu
The Bancroft Brothers Animation Podcast op Apple Podcasts
podcasts.apple.comFocus forces brutal prioritization
Making few bets forces you to make hard decisions. It’s extremely hard to measure the value of something against some abstract and absolute notion of value.
Proponents of diversification argue that it takes the edge off of making a mistake. That would be a good argument if people acted the same way independent of... See more
Making few bets forces you to make hard decisions. It’s extremely hard to measure the value of something against some abstract and absolute notion of value.
Proponents of diversification argue that it takes the edge off of making a mistake. That would be a good argument if people acted the same way independent of... See more
Why Diversification Results In Mediocrity
Writing & publishing system
Be willful
A big secret is that you can bend the world to your will a surprising percentage of the time—most people don’t even try, and just accept that things are the way that they are.
People have an enormous capacity to make things happen. A combination of self-doubt, giving up too early, and not pushing hard enough prevents most people from ever... See more
A big secret is that you can bend the world to your will a surprising percentage of the time—most people don’t even try, and just accept that things are the way that they are.
People have an enormous capacity to make things happen. A combination of self-doubt, giving up too early, and not pushing hard enough prevents most people from ever... See more