Skip to content
Sagan

Paper

The Effect of Training Task Diversity on In-Context Learning through the Lens of Low-Dimensional Subspaces

Unreadunread

AI summary

arXiv:2606. 06814v1 Announce Type: new Abstract: The transformer's emergent ability to perform in-context learning (ICL) has sparked a wide range of studies designed to understand its underlying mechanisms.