Skip to content
Sagan

Paper

Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models

Unreadunread

AI summary

arXiv:2605. 20187v1 Announce Type: new Abstract: Understanding dependencies between variables is critical for interpretability and efficient generation in masked diffusion models (MDMs), yet these models primarily expose marginal conditional distributions and do not explicitly represent inter-variable dependence.