Skip to content
Sagan

Paper

Mechanistic origins of catastrophic forgetting: why RL preserves circuits better than SFT?

Unreadunread

AI summary

arXiv:2605. 28860v1 Announce Type: new Abstract: Fine-tuning large language models (LLMs) frequently induces catastrophic forgetting of prior capabilities.