Two Forms of the Dot Product
gregorygundersen.com
Two Forms of the Dot Product
If you slept through High School Math (like I did), the Content Examples Project got you covered.
It goes through all of the basic vector math you need on a daily basis when making games. https://t.co/QgB4D43Tbj
Cobra Codex.com
Excellent explanation of RoPE embedding, from scratch with all the math needed: https://t.co/Y1LlEAJrtj
And with beautiful 3blue1brown's style of animation: https://t.co/9x8JdRWAww.
Original RoPE paper: https://t.co/3Qv0gN82H9 https://t.co/QYFklqG0Ld
In ordinary Euclidean space, the dot product of two vectors is the product of the length of both vectors times the cosine of the angle between them.