Skip to content
Sagan

Paper

Spokes: Optimizing for Diverse Pretraining Data Selection

Unreadunread

AI summary

arXiv:2606. 15216v1 Announce Type: new Abstract: Diversity plays a critical role in data selection, improving performance under fixed data budgets by reducing redundancy and repetition.