arXiv:2606. 19538v1 Announce Type: new Abstract: Convolutional networks, recurrent networks, and transformers each encode different inductive biases -- locality, sequential memory, and content-dependent pairwise interaction -- and have remained mathematically distinct since their inception.
Paper
ITNet: A Learnable Integral Transform That Subsumes Convolution, Attention, and Recurrence
Unreadunread