Skip to content
Sagan

Paper

MixSD: Mixed Contextual Self-Distillation for Knowledge Injection

Unreadunread

AI summary

arXiv:2605. 16865v1 Announce Type: new Abstract: Supervised fine-tuning (SFT) is widely used to inject new knowledge into language models, but it often degrades pretrained capabilities such as reasoning and general-domain performance.