Skip to content
Sagan

Paper

Quantization Undoes Alignment: Bias Emergence in Compressed LLMs Across Models and Precision Levels

Unreadunread

AI summary

arXiv:2605. 15208v1 Announce Type: new Abstract: Large Language Models are routinely compressed via post-training quantization to reduce inference costs and memory footprint for cloud and edge deployment, yet the impact of this compression on model quality remains poorly understood.