NoiseRater is a meta-learning framework that assigns importance scores to individual noise samples in diffusion model training, rather than treating all noise uniformly. A parametric "noise rater" network conditions on the data and timestep to weight each noise realization, and is trained via bilevel optimization to improve downstream validation loss. The authors then deploy a two-stage pipeline: soft weighting during meta-training, then hard noise selection during standard training. Experiments on FFHQ and ImageNet show that prioritizing informative noise improves both training efficiency and generation quality.
Main takeaways:
- Standard diffusion training treats all injected noise samples as equally informative; NoiseRater challenges this by learning per-instance noise importance.
- A parametric rater assigns scores conditioned on data and timestep; it's trained via bilevel optimization (meta-learned to improve validation after inner diffusion updates).
- A decoupled two-stage pipeline transitions from soft reweighting (meta-training) to hard noise selection (standard training) for efficiency.
- Empirically, not all noise is equal—prioritizing high-value noise improves both training speed and final image quality on FFHQ and ImageNet.