Sublime

Someone just reminded me of this lecture I gave in 2009 that described the evolution of Google Search from 1999 to 2009. People who are interested in how our search systems work might find this interesting. It touches on disk-based serving systems, in-memory indices, compression schemes for inverted indices, latency... See more

The @JeffDean & @NoamShazeer episode. We talk about 25 years at Google, from PageRank to MapReduce to the Transformer to MoEs to AlphaChip – and soon to ASI. My favorite part was Jeff's vision for AGI as one giant MoE that is grown in bits and pieces over time like a forest, rather than... See more

After 2️⃣5️⃣ years @Google, our Chief Scientist and co-lead of the Gemini foundation model, @JeffDean has a unique insight into the past, present and future of AI. Listen in to his conversation with Professor @fryrsquared on the latest episode of Google DeepMind: The Podcast ↓ https://t.co/u3GGG5Cc4p

I’m building something new: https://t.co/H4OndIW6jv Everyone’s talking about Devin and AI coding agents. But what about management? With more automated workers, every engineering manager will be in charge of larger, faster teams. It will come fast and they need better... See more

Jeff Dean and Noam Shazeer are among the godfathers of modern AI at Google. Most interesting ideas from the recent Dwarkesh podcast: 1. If AI can automate chip design and a "million automated researchers" can generate novel model architectures, AI development might continue to accelerate... See more

If you want to know more about how Google Flights works, airline tickets, and why it is super complicated to deal with all the constraints and the combinatorial combinations, I highly recommend this set of slides by Carl de Marcken, one of the co-founders of ITA software, which Google acquired and became one of the underpinnings of Google... See more