Sublime
An inspiration engine for ideas
In the physical world, almost all information is transmitted through traveling waves -- why should it be any different in your neural network?
Super excited to share recent work with the brilliant @mozesjacobs: "Traveling Waves Integrate Spatial Information Through Time"
1/14 https://t.co/Bs4UKR7j21
Andy Kellerx.com
99% of all life by biomass learns just by mutating DNA, no neurons. Artificial neural nets taught us a lot, but to truly understand intelligence we also need to recreate DNA.
I made a repo on artificial DNA. It solves tic-tac-toe reliably in 30min.
https://t.co/FaAovV7i3e https://t.co/Kg0oeDBaSG
This is a beautiful paper by Anthropic!
My intuition: neural networks are voting networks.
Imagine millions of entities voting: "In my incoming information, I detect this feature to be present with this strength".
Aggregate a pyramid of votes to add up to output... See more
Been trying to reconcile a bunch of different aspects of NN behavior and cognition by playing with formulations of latent space at a level (also) suited for reasoning about everyday cognitive phenomena
In part it's led to a compact, diagrammable geometric system https://t.co/BnQrwzZBTF
Some blogs change your perception, and this one by Andrej Karpathy is one of those. https://t.co/j5FCONS39x
