Sublime
An inspiration engine for ideas
Analyzing the evolutionary origin of human creativity, proposing it evolved for cultural transmission rather than knowledge generation.
TRANSCRIPT
How did humans start generating knowledge and why has no other species been capable of doing that? We are today the only species that can do that, but we haven't always been, since we know that previous species like Homo erectus and the Neanderthals must have had the same ability because they made technology that seems impossible to have
... See more
Michael Jordan gave a short, excellent, and provocative talk recently in Paris - here's a few key ideas
- It's all just machine learning (ML) - the AI moniker is hype
- The late Dave Rumelhart should've received a Nobel prize for his early ideas on making backprop... See more
Another banger by Emily Bender on synthetic text, the scale hypothesis and stochastic parrots
https://t.co/215vlJnYjq
ruby justice thelotx.com
Exploring Scaling Laws for Local SGD in Large Language Model Training
https://t.co/OwZwsT2Qgv
They propose scaling laws for DiLoCo (https://t.co/q21VQaxLSJ, ~FedOpt/LocalSGD with inner Adam + outer Nesterov) from 5M to 3B parameters.
Afaik this is the largest... See more
studying the motivations of individuals in isolation: the patterns we see are a fundamentally social affair. More, as Anderson
Jessica C. Flack • Worlds Hidden in Plain Sight: The Evolving Idea of Complexity at the Santa Fe Institute, 1984–2019 (Compass)
First Dimension: Technical Evolution
- From Models to Systems: The shift from isolated models to integrated systems capable of processing information and adapting to their environment
- From Systems to Agents: The emergence of autonomous entities that can perceive, reason, and act toward goals
- From Agents to Collectives: The development of agent networks
Helen Edwards • The Evolution of AI: From Models to Agents to Social Intelligence
When something happens to the expectation value, is that actually also what happens over a long time to the thing that we are observing?