Skip to content
Sagan

Paper

The Implicit Bias of Steepest Descent with Mini-batch Stochastic Gradient

Unreadunread

AI summary

arXiv:2602. 11557v2 Announce Type: cross Abstract: A variety of widely used optimization methods like SignSGD and Muon can be interpreted as instances of steepest descent under different norm-induced geometries.