Meta 🤝 Apple Llama 4 + Apple Silicon is a match made in heaven. Here's why: Like DeepSeek V3/R1, all of the new Llama 4 variants are massive sparse MoE models. They have a massive amount of parameters, but only a small number of those are active each time a token is generated. We don't know... See more

a quick note from @karpathy talk, which afterwards I was fully immersed in the talk I stopped writing down/taking notes: While it is interesting to think about LLMs in terms of "electricity" -> CAPEX to train an LLM (~= to build the grid) -> OPEX to serve intelligence over increasingly homogeneous API (prompt, image, to... See more

I'm writing a blog post on general advice for building a GPU machine learning rig for home use. WIP version in the post below https://t.co/xasO6MD6Y4