Skip to content
Sagan

Paper

UniSVQ: 2-bit Unified Scalar-Vector Quantization

Unreadunread

AI summary

arXiv:2606. 10520v1 Announce Type: new Abstract: Post-training quantization at the 2-bit level enables low-cost deployment and inference acceleration for large language models (LLMs).