Skip to content
Sagan

Paper

In-Context Optimization for Retrieval-Augmented Generation: A Gradient-Descent Perspective

Unreadunread

AI summary

arXiv:2605. 26356v1 Announce Type: new Abstract: In-context learning has recently been linked to implicit gradient descent in linear self-attention models, suggesting that context can induce a forward-pass update.