Skip to content
Sagan

Paper

FuRA: Full-Rank Parameter-Efficient Fine-Tuning with Spectral Preconditioning

Unreadunread

AI summary

arXiv:2605. 22869v1 Announce Type: new Abstract: Both full fine-tuning (Full FT) and parameter-efficient fine-tuning methods such as LoRA introduce weight updates without accounting for the spectral structure established during pretraining.