Skip to content
Sagan

Paper

The Discrete-Log Clock: How a Transformer Learns Modular Multiplication

Unreadunread

AI summary

arXiv:2606. 17399v1 Announce Type: new Abstract: When small transformers grok modular multiplication, prior work reports that the learned embedding has a "dense" Fourier spectrum requiring all frequencies.