The End of Cloud Inference

The End of Cloud Inference Most people picture the future of AI the same way they picture the internet: somewhere far away, inside giant buildings full of humming machines. Your phone or laptop sends a request, a distant data center does the thinking, and the answer streams back. That story has ...

docs.google.com

RelatedInsightsHighlights

Great read! Two thoughts I was prompted into: One realization I return back to since the announcement is the Apple dilemma of needing the thing that gets everyone to really want to upgrade to the latest iPhone, and that perhaps they've been flattening out on that with the last few generations. Apple Intelligence can... See more

Andrej Karpathy x.com

DeepSeek FAQ

Ben Thompson stratechery.com

Basic summary of Apple Intelligence so far: On-device large language and diffusion models that deliver helpful features across iPhone and other devices with on-device symantic index that can bring in information across your devices and apps Private cloud compute allows it to draw on larger server-based models while... See more

Marques Brownlee x.com