Sublime
An inspiration engine for ideas
Amazing graphical representation of a neural net, never seen anything like it. https://t.co/1xUQHAiq50
Gabriel Elblingx.com
If you’re bored with today’s neural net architectures, then my advice to you is to start training models to use an external memory, now that RL is finally working. https://t.co/qXm1PRECSp
In the physical world, almost all information is transmitted through traveling waves -- why should it be any different in your neural network?
Super excited to share recent work with the brilliant @mozesjacobs: "Traveling Waves Integrate Spatial Information Through Time"
1/14 https://t.co/Bs4UKR7j21
Andy Kellerx.com
99% of all life by biomass learns just by mutating DNA, no neurons. Artificial neural nets taught us a lot, but to truly understand intelligence we also need to recreate DNA.
I made a repo on artificial DNA. It solves tic-tac-toe reliably in 30min.
https://t.co/FaAovV7i3e https://t.co/Kg0oeDBaSG

This is a beautiful paper by Anthropic!
My intuition: neural networks are voting networks.
Imagine millions of entities voting: "In my incoming information, I detect this feature to be present with this strength".
Aggregate a pyramid of votes to add up to output... See more

2024 physics laureate Geoffrey Hinton used a network developed by his co-laureate John Hopfield as the foundation for a new network: the Boltzmann machine. This can learn to recognise characteristic elements in a given type of data.
The Boltzmann machine can be used to classify images or create new examples of the type... See more


