Skip to content
Sagan

Paper

Unsteady Metrics and Benchmarking Cultures of AI Model Builders

Unreadunread

AI summary

arXiv:2605. 14164v1 Announce Type: new Abstract: The primary way to establish and compare competencies in foundation and generative AI models has shifted from peer-reviewed literature to press releases and company blog posts, where model builders highlight results on selected benchmarks.