Skip to content
Sagan

Paper

SignMuon: Communication-Efficient Distributed Muon Optimization

Unreadunread

AI summary

arXiv:2605. 16311v1 Announce Type: new Abstract: Distributed training of large neural networks is bottlenecked by full-precision gradient communication and by coordinatewise optimizers that ignore the matrix structure of weight tensors.