Skip to content
Sagan

Paper

The Routing and Filtering Structure of Attention

Unreadunread

AI summary

arXiv:2605. 18826v1 Announce Type: new Abstract: The attention interaction matrix $QK^{\top}$ contains two entangled computations: a skew-symmetric component that redistributes information between positions (routing) and a symmetric component that scales mutual relevance (filtering).