Skip to content
Sagan

Paper

Tensor Cache: Eviction-conditioned Associative Memory for Transformers

Unreadunread

AI summary

arXiv:2605. 22884v1 Announce Type: new Abstract: Autoregressive Transformer KV caches grow linearly with context length; sliding-window caching bounds memory but discards evicted tokens entirely, so relevant evidence outside the window becomes inaccessible.