Skip to content
Sagan

Paper

A Theory of Saddle Escape in Deep Nonlinear Networks

Unreadunread

AI summary

arXiv:2605. 01288v3 Announce Type: replace-cross Abstract: In deep networks with small initialization, training exhibits long plateaus separated by sharp feature-acquisition transitions.