Skip to content
Sagan

Paper

Unlocking Latent Value: Taxonomy-Guided Recovery of High-Performing Data from Low-Tier Web Corpora

Unreadunread

AI summary

arXiv:2606. 07778v1 Announce Type: new Abstract: Dominant web data curation pipelines for pretraining collapse document quality into a single composite score, systematically missing high-value content along dimensions the scorer underweights.