Sublime
An inspiration engine for ideas
Turing proved that one particular computer of this type, the universal Turing machine, had the combined repertoire of all other Turing machines. He conjectured that this repertoire consisted precisely of ‘every function that would naturally be regarded as computable’. He meant computable by mathematicians.
David Deutsch • The Fabric of Reality
Most do not know that computers were invented initially to show that mathematics is inconsistent and incomplete. It was a profoundly blackpilling moment for lots of mathematicians.
The story starts with David Hilbert, a German mathematician, who was insanely jazzed about the future of mathematics. In 1900, at the... See more
Turing’s genius: he discovered that if two machines had been initialized in the same way, it introduced a slight bias in the distribution of letters, so that the two messages were slightly more likely to resemble each other.
Stanislas Dehaene • How We Learn: Why Brains Learn Better Than Any Machine . . . for Now
"but attention is turing complete"
well so are dancing crabs! now go ahead and implement snake in attention. there is actually a very nice site that explains how to use attention as a programming language. i highly recommend it. once you understand that everything GPT does must be executed through this ultra limited,... See more
Taelinx.com
This is what I was getting at in my essay, "Why AGI is closer than you think."
The genome is less a blueprint than a compressed representation that parameterizes the developmental process via a hierarchy of feedback loops guided by energy minimization. https://t.co/4UfyN0buXa
Chain of thought prompting helps planning, but only so much.
A common hunch about why CoT sometimes helps is that Auto-Regressive LLMs devote a fixed amount of computation per token, hence tricking them into producing more tokens allows them to devote more computation and more in-context working memory" to the... See more
Yann LeCunx.com
