Skip to content
Sagan

Paper

Noise-Driven Escape from Metastable Phases explains Grokking in Deep Neural Networks

Unreadunread

AI summary

arXiv:2606. 17120v1 Announce Type: new Abstract: Deep neural networks (DNNs) exhibit first order phase transitions under variations of the L2 regularization strength, with each transition marking the onset of a new learnable feature.