Skip to content
Sagan

Paper

Small Experiments, Cheaper Decisions: A Case Study in Staged Promotion for Micro-Pretraining

Unreadunread

AI summary

arXiv:2606. 11387v1 Announce Type: new Abstract: Short pretraining runs can reduce experimental cost, but they can also over-promote configurations that only look strong at tiny budgets.