Luc Cheung
@luccheung
Luc Cheung
Self-Attention in Detail
Let’s first look at how to calculate self-attention using vectors, then proceed to look at how it’s actually implemented – using matrices.
The first step in calculating self-attention is to create three vectors from each of the encoder’s input vectors (in this case, the embedding of each word). So for each word, we create a... See more
Let’s first look at how to calculate self-attention using vectors, then proceed to look at how it’s actually implemented – using matrices.
The first step in calculating self-attention is to create three vectors from each of the encoder’s input vectors (in this case, the embedding of each word). So for each word, we create a... See more
Jay Alammar • The Illustrated Transformer
2 years. Dozens of scripts. 1,000,000s of views.
Here are 10 scriptwriting fundamentals I stand by for almost any YouTube video 🧵: https://t.co/rR9sovOTmg
The opposite of process is chaos, but an in-between is rapid adaptation, emphasis on rapid . Limit scope as much as possible, ship small things fast, and react to feedback quickly.
The design process assumes that dev time is the utmost priority, and this moves a bulk of labor into the design process. This is a faulty premise. The most valuable thing... See more
The design process assumes that dev time is the utmost priority, and this moves a bulk of labor into the design process. This is a faulty premise. The most valuable thing... See more
The Design Process is a Trap - Adil Majid
Interfaces used to be the solution. “There’s an app for that” was music to our ears.
But now interfaces are overused. They’re getting in the way. Instead of pragmatic solutions, we’re building clunky apps.
The solution is not a better app. The solution is no app – no interface.
Example: an app to open your car. Krishna explains how such an app can... See more
But now interfaces are overused. They’re getting in the way. Instead of pragmatic solutions, we’re building clunky apps.
The solution is not a better app. The solution is no app – no interface.
Example: an app to open your car. Krishna explains how such an app can... See more
Golden Krishna • Notes on The Best Interface is No Interface
"Form should follow function"
Curators, Curators
It has become popular to say we live in the information age, and we need curation to help us sort through the mess. But thus far, the conversation around “curation” has been too focused on the content and not enough on the structure. We seem to have accepted the job of the curator as providing a product review, a list of links, a... See more
It has become popular to say we live in the information age, and we need curation to help us sort through the mess. But thus far, the conversation around “curation” has been too focused on the content and not enough on the structure. We seem to have accepted the job of the curator as providing a product review, a list of links, a... See more
sariazout.mirror.xyz • Re-Organizing the World’s Information: Why We Need More Boutique… — Mirror
