Skip to content
Sagan

Paper

The Coin Flip Judge? Reliability and Bias in LLM-as-a-Judge Evaluation

Unreadunread

AI summary

arXiv:2606. 13685v1 Announce Type: new Abstract: LLM-as-a-Judge is now widely used to rank model outputs, train reward models, and populate public leaderboards, but its run-to-run reliability remains under-characterized.