Positional Encoding

This is an educational App for readers interested in the sin/cos encoding of the token positions in large language models (LLM).

Play with this App to acquire a deeper understanding of the positional encoder as it was described in the famous *Attention is All You Need* paper.

In particular the App shows how the correlation between two positional vectors depends only on the distance between the corresponding two integer position.