Skip to content
Sagan

Paper

Gaussian Mixture Attention: Linear-Time Sequence Mixing via Probabilistic Latent Routing

Unreadunread

AI summary

arXiv:2606. 18283v1 Announce Type: new Abstract: The dense token-to-token interaction pattern of standard dot-product attention remains a central bottleneck in scaling Transformer architectures to long contexts.