The authors propose the Safety-Aware Denoiser (SAD), a safety-guidance method for text diffusion models that steers generation toward safe text during the iterative denoising process. Instead of post-hoc filtering or retraining the model, SAD modifies each denoising step at inference time to guide the final sample into provably safe regions of text space. The method is lightweight, avoids expensive retraining, and can flexibly integrate different safety constraints. Experiments show SAD substantially reduces unsafe generations across hazard taxonomy, memorization, and jailbreak benchmarks while preserving quality, diversity, and fluency.
Main takeaways:
- Existing safety methods (post-hoc filters, inference-time interventions) don't translate well from autoregressive models to diffusion-based text generation.
- SAD intervenes during the denoising loop itself, steering samples toward safe regions of text space without retraining the diffusion model.
- The method is inference-time only, so it's computationally cheap and flexible—you can swap in different safety constraints.
- Evaluations cover hazard taxonomy (toxic content categories), memorization (verbatim training data leakage), and jailbreak prompts.
- SAD outperforms existing baselines on safety metrics while maintaining generation quality, diversity, and fluency.