Skip to content
Sagan

Paper

FastMix: Fast Data Mixture Optimization via Gradient Descent

Unreadunread

AI summary

arXiv:2606. 14971v1 Announce Type: new Abstract: While large and diverse datasets have driven recent advances in large models, identifying the optimal data mixture for pre-training and post-training remains a significant open problem.