Skip to content
Sagan

Paper

PolyKV: Heterogeneous Retention and Allocation for KV Cache Compression

Unreadunread

AI summary

arXiv:2606. 15157v1 Announce Type: new Abstract: KV cache compression is essential for reducing the memory cost of long-context large language model inference.