Skip to content
Sagan

Paper

Regret Pre-training: Bridging Prior and Posterior Views for Enhanced Knowledge Grounding

Unreadunread

AI summary

arXiv:2606. 03080v1 Announce Type: new Abstract: Causal language models factorize sequence probabilities using only preceding context, leaving future information unexploited during training despite its availability in the training data.