Skip to content
Sagan

Paper

Flatness and Generalization: Learning Multi-Index Models with Homogeneous Neural Networks

Unreadunread

AI summary

arXiv:2606. 04429v1 Announce Type: new Abstract: A common heuristic used to explain the generalization of first-order gradient methods on non-convex neural networks is that "flat interpolators generalize well" (Hochreiter and Schmidhuber, 1994; Keskar et al.