Skip to content
Sagan

Paper

NumLeak: Public Numeric Benchmarks as Latent Labels in Foundation Models

Unreadunread

AI summary

arXiv:2605. 30393v1 Announce Type: new Abstract: Public numeric benchmarks appear in pretraining, so an evaluation that conditions on a date may be measuring memorized recall rather than out-of-sample skill.