Position Encodings

Sinusoidal, learned, relative, RoPE, ALiBi — how transformers know where tokens live.

1. 1. ○ Implement Positional Encoding
2. 2. ○ Relative Position Encoding
3. 3. ○ Rotary Position Embeddings
4. 4. ○ ALiBi Position Bias
5. 5. ○ Transformer Block with RoPE