A distribution- and serving-state-oriented study note on speculative decoding, draft models, target verification, exact speculative sampling, correction distributions, acceptance rate, speedup ledgers, and KV rollback.
A mechanism-oriented study note on Medusa decoding heads, same-model candidate generation, candidate trees, tree attention masks, typical acceptance, Medusa-1, Medusa-2, and branch KV state.
A mechanism-oriented study note on Lookahead decoding, Jacobi iterations, 2D windows, n-gram pools, lookahead and verification branches, exactness, masks, and KV state.
A derivation- and implementation-oriented study of multi-token prediction objectives, shifted labels, shared-trunk gradients, prediction-head designs, training memory, and the boundary between denser supervision and faster inference.