Positional Embeddings

The Transformer has no built-in sense of order — positional embeddings are how we inject that information. This series builds the full picture, from the original sinusoidal scheme to modern alternatives like RoPE and ALiBi.