Skip to content
Sagan

Paper

A Pre-Training Analogue of Grokking in Language Models: Tracing Delayed Grammatical Generalization

Unreadunread

AI summary

arXiv:2606. 00230v1 Announce Type: new Abstract: Grokking, the phenomenon in which neural networks generalize long after fitting their training data, has been studied in supervised settings on many epochs.