Skip to content
Sagan

Paper

Beyond Mode Collapse: Distribution Matching for Diverse Reasoning

Unreadunread

AI summary

arXiv:2605. 19461v1 Announce Type: new Abstract: On-policy reinforcement learning methods like GRPO suffer from mode collapse: they exhibit reduced solution diversity, concentrating probability mass on a single solution once discovered and ceasing exploration of alternative strategies.