Skip to content
Sagan

Paper

Muon$^p$: Muon with Fractional Spectral Powers

Unreadunread

AI summary

arXiv:2606. 13867v1 Announce Type: new Abstract: Muon is an increasingly widely used optimizer that replaces a gradient $G=USV^\top$ with its polar factor $UV^\top$, thereby flattening the singular spectrum.