luca
@fahrenheit
ML researcher, interested in math and probabilistic machine reasoning.
luca
"Don’t think. Thinking is the enemy of creativity. It’s self-conscious, and anything self-conscious is lousy. You can’t try to do things. You simply must do things."
- Ray Bradbury
In the work with LLMs lies a deeper question, that I have not been able to answer for myself properly so far. I can use an LLM to extract information, summarise, distill, but it feels like I am fooling myself. The work that I have done is not done by me. I am have not made any connections in my brain. It feels like we should not use them for
... See moreFino alla fine, con gli occhi aperti e il cuore saldo. A testa alta - sempre.
Until the end, with eyes open and a steady heart. Head held high - always.
— 5th May 2025 5:20 AM, somewhere in London
The Fisher information matrix is simply the Hessian of KL divergence at the point where two distributions are equal.
Metacademy - Differential geometry for machine learning
However, there’s a third way to think about the first moment, and it’s the one that I think is most useful for understanding moments generally: the first moment tells us how far away from the origin the center of mass is. I like this interpretation because it is analogous to a moment arm in mechanics, which is the length of an arm between an axis... See more
Understanding Moments
This is so good.
Maria
maria.cloudThe glow in the centre of the k-space image represents the lower spatial frequencies, which contains the bulk of the image contrast information. As we move away from this central glow, the finer details and edges, representing the higher spatial frequencies