Skip to content
Sagan

Paper

Always Learning, Always Mixing: Efficient and Simple Data Mixing All The Time

Unreadunread

AI summary

arXiv:2605. 15220v1 Announce Type: new Abstract: Data mixing decides how to combine different sources or types of data and is a consequential problem throughout language model training.