Skip to content
Sagan

Paper

BudgetDraft: Acceptance-Aware Multi-View Training for Sparse-KV Speculative Decoding

Unreadunread

AI summary

arXiv:2606. 00144v1 Announce Type: new Abstract: Speculative decoding speeds up autoregressive decoding by using a drafter to propose multiple tokens that a verifier validates in parallel.