Skip to content
Sagan

Paper

When Is Next-Token Prediction Useful? Marginalization, Ergodicity, Mixture Identifiability, Local Sufficiency, RAG, Tools, and Programming

Unreadunread

AI summary

arXiv:2605. 23278v1 Announce Type: cross Abstract: Language models trained on observed sequences are often described as learning the conditional distribution of the next token given previous tokens.