Skip to content
Sagan

Paper

CODEBLOCK: Learning to Supervise Code at the Right Granularity

Unreadunread

AI summary

arXiv:2606. 18286v1 Announce Type: new Abstract: Supervised fine-tuning of code LLMs typically applies uniform cross-entropy loss to all response tokens, implicitly assuming that every token provides equally useful learning signal.