The authors provide a structured overview of uncertainty quantification for machine learning in physics, where scientific discoveries require validated probabilistic statements. They introduce a unified taxonomy of uncertainty types, clarify the interpretation of predictive vs. inference uncertainties across frequentist and Bayesian frameworks, and discuss validation tools including coverage, calibration, bias tests, and proper scoring rules. The paper illustrates these concepts with simple regression and classification examples.
Main takeaways:
- Reliable uncertainty quantification is essential for using ML in physics, where discoveries depend on validated probabilistic statements.
- The paper provides a unified taxonomy of uncertainty types and clarifies predictive vs. inference uncertainty in frequentist and Bayesian frameworks.
- Validation tools include coverage (does the uncertainty interval contain the true value at the right frequency?), calibration, bias tests, and proper scoring rules.
- The overview is illustrated with simple regression and classification examples.
- The paper serves as a structured reference for principled uncertainty quantification in physics applications of ML.