Skip to content
Sagan

Paper

Probing the Prompt KV Cache: Where It Becomes Dispensable

Unreadunread

AI summary

arXiv:2605. 30574v1 Announce Type: new Abstract: Prior KV cache compression schemes empirically demonstrate that the prompt cache is partially redundant during decoding, dropping or summarising entries with little accuracy loss.