Skip to content
Sagan

Paper

Dual Dimensionality for Local and Global Attention

Unreadunread

AI summary

arXiv:2606. 18587v1 Announce Type: new Abstract: Decoder-only Transformers compute attention over the KV cache of preceding tokens.