Skip to content
Sagan

Paper

Parameter-Efficient Fine-Tuning with Learnable Rank

Unreadunread

AI summary

arXiv:2606. 04325v1 Announce Type: new Abstract: Low-Rank Adaptation (LoRA) is a popular parameter-efficient fine-tuning (PEFT) method that restricts weight updates to low-rank adapters, introducing a fixed low-rank inductive bias by optimizing in a low-dimensional subspace.