Skip to content
Sagan

Paper

Models Take Notes at Prefill: KV Cache Can Be Editable and Composable

Unreadunread

AI summary

arXiv:2606. 17107v1 Announce Type: new Abstract: Prefix caching reuses prefill only across an exactly shared prefix, so one changed field invalidates the entire downstream cache.