Luc Cheung

Here's exactly how I approach building AI side projects in 6 steps: 1. Think of an idea that excites me but that is very simple. I should be able to describe it in 5 words to anyone. 2. Take a weekend and block it off entirely to focus on building the app. I'll generally take 15-30 hours to build an initial version. 3. Try to incorporate the latest... See more

Self-Attention in Detail

Let’s first look at how to calculate self-attention using vectors, then proceed to look at how it’s actually implemented – using matrices.

The first step in calculating self-attention is to create three vectors from each of the encoder’s input vectors (in this case, the embedding of each word). So for each word, we create a... See more

Nassim Taleb says if you’re going to panic in investing, panic early. Same goes for your career – if you’re going to quit, quit early so whatever’s next has a shot at compounding.

Unsurprisingly, hiring friends and former colleagues was by far the biggest channel. This also in part explains why multi-time founders, and anyone with a large network (e.g. Y Combinator), have an advantage:

“All of our early hires were friends/ex-coworkers.”

“First hires were practically all former colleagues. Several people who worked with me in

... See more

One thing I do look back on fondly was how incredibly focused we were. Resources and time were so tight that you could feel the weight of all the things you weren’t working on. You had real conviction that the thing you were doing was the most important thing.

To pick a somewhat trivial example, at fireside chats with Mark (the predecessor to the... See more