Skip to content
Sagan

Paper

Theory-optimal Quantization Based on Flatness

Unreadunread

AI summary

arXiv:2605. 18800v1 Announce Type: new Abstract: Post-training quantization has emerged as a widely adopted technique for compressing and accelerating the inference of Large Language Models (LLMs).