Skip to content
Sagan

Paper

Attention as In-Context Empirical Bayes: A Two-Stage View via Particle Dynamics

Unreadunread

AI summary

arXiv:2605. 29351v1 Announce Type: cross Abstract: We study minimal attention-only transformers under all-token corruption and show they admit a two-stage empirical Bayes interpretation.