Sublime

The Moore's Law Update NOTE: this is a semi-log graph, so a straight line is an exponential; each y-axis tick is 100x. This graph covers a 1,000,000,000,000,000,000,000x improvement in computation/$. Pause to let that sink in. Humanity’s capacity to compute has compounded for as long as we can measure it,... See more

People are just starting to realize the power of Local LLMs Especially with new Apple chips. It's a game-changer Let me show you: Falcon is 180B LLM. It is the size of GPT3. How fast would it run on your Mac? Apple M3 Max: 3.5... See more

Listening to Jensen Huang on $NVDA call last night, the new paradigm which Nvidia created truly dawned on me. A spider web of companies serving a completely new accelerated computing environ. Nvidia created this over the span of 1 decade. Made a slide to visualize... https://t.co/9ysYtQss02

> be me, Intel > world domination status: achieved > have a license to print money with x86 > life is good > be 2007, some fruit company named Apple shows up > "hey can you make a chip for our new phone?" > my CFO brain activates > look at their... See more

OpenAI had a significant lead from summer 2022 through spring 2024 when Google and Anthropic caught up to GPT-4. 7ish quarters of dominance as a result of being the first to aggressively bet on the traditional scaling “law” for pre-training. Being first to reasoning with o1 only led to a few months of... See more

Meta 🤝 Apple Llama 4 + Apple Silicon is a match made in heaven. Here's why: Like DeepSeek V3/R1, all of the new Llama 4 variants are massive sparse MoE models. They have a massive amount of parameters, but only a small number of those are active each time a token is generated. We don't know... See more

A single fairly unknown Dutch company makes maybe the most expensive and complex non-military device ($200M) that builds on 40 years of Physics and has a monopoly responsible for all AI advancement today. Here's the story of ASML, the company powering Moore's Law.. 1/9... See more