Skip to content
Sagan

Paper

When Softmax Fails at the Top: Extreme Value Corrections for InfoNCE

Unreadunread

AI summary

arXiv:2606. 00262v1 Announce Type: new Abstract: InfoNCE is the standard contrastive learning objective, but its softmax form is not only a computational convenience: it also encodes a statistical assumption about how the top-scoring example is selected.