Skip to content
Sagan

Paper

CompactAttention: Accelerating Chunked Prefill with Block-Union KV Selection

Unreadunread

AI summary

arXiv:2605. 16839v1 Announce Type: new Abstract: Chunked prefill has become a widely adopted serving strategy for long-context large language models, but efficient attention computation in this regime remains challenging.