arXiv:2605. 30844v1 Announce Type: cross Abstract: Fine-tuning is often believed to reduce uncertainty and diversity in large language models, but existing analyses overlook output length, a key confounder, and therefore fail to capture how uncertainty is distributed across an entire generation rollout.
Paper
Fine-Tuning Improves Information Conveyance in Language Models
Unreadunread