Skip to content
Sagan

Paper

Filter, Then Reweight: Rethinking Optimization Granularity in On-Policy Distillation

Unreadunread

AI summary

arXiv:2606. 02684v1 Announce Type: new Abstract: On-Policy distillation (OPD) in large language models is shifting from full-trace KL supervision toward more selective training paradigms.