Skip to content
Sagan

Paper

Speculative Decoding Across Languages

Unreadunread

AI summary

arXiv:2605. 30580v1 Announce Type: new Abstract: Speculative decoding has become a crucial component of large language model (LLM) inference, enabling faster generation by drafting multiple tokens and verifying them in parallel.