Skip to content
Sagan

Paper

D-PACE: Dynamic Position-Aware Cross-Entropy for Parallel Speculative Drafting

Unreadunread

AI summary

arXiv:2605. 18810v1 Announce Type: new Abstract: Speculative decoding accelerates LLM inference by having a small drafter propose tokens that a larger target model verifies in parallel.