Skip to content
Sagan

Paper

Spectral Scaling Laws of Muon

Unreadunread

AI summary

arXiv:2606. 04058v1 Announce Type: new Abstract: Orthonormalized update rules have rapidly become a leading choice of optimizer for training large language models, with recent open-source state-of-the-art models adopting Muon.