Skip to content
Sagan

Paper

Reward Learning from Best-of-$N$ Preference Data: Targets, Tradeoffs, and Design Principles

Unreadunread

AI summary

arXiv:2605. 30619v1 Announce Type: new Abstract: Best-of-$N$ sampling is widely used to construct pairwise preference data: $N$ candidates are drawn from a base distribution, and the best is paired with a rejected response.