Skip to content
Sagan

Paper

Enabling KV Caching of Shared Prefix for Diffusion Language Models

Unreadunread

AI summary

arXiv:2606. 07571v1 Announce Type: new Abstract: Key-value (KV) caching for shared prefixes is essential for high-throughput large language model (LLM) serving, but it faces critical challenges in emerging diffusion language models (DLMs).