Skip to content
Sagan

Paper

Preference Instability in Reward Models: Detection and Mitigation via Sparse Autoencoders

Unreadunread

AI summary

arXiv:2605. 16339v1 Announce Type: new Abstract: Preference learning in large language models relies on reward models as proxies for human judgment.