Skip to content
Sagan

Paper

Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation

Unreadunread

AI summary

arXiv:2606. 09864v1 Announce Type: new Abstract: Key-value (KV) cache quantization is widely used to reduce Large Language Model (LLM) inference memory, yet existing evaluations solely focus on measuring perplexity and accuracy without assessing the safety impact.