Skip to content
Sagan

Paper

Accelerating Speculative Diffusions via Block Verification

Unreadunread

AI summary

arXiv:2606. 13426v1 Announce Type: cross Abstract: Speculative decoding speeds up LLM inference by using a draft model to generate tokens, with an acceptance-rejection scheme that ensures that the output matches the target distribution.