Speculative decoding introduced in: Leviathan, Kalman, Matias 2023 — Google Research.
Subject
Speculative decoding
Object
Leviathan, Kalman, Matias 2023 — Google Research
Primary source · preprint · 2022-11-30
Fast Inference from Transformers via Speculative Decoding — arXiv (Leviathan, Kalman, Matias / Google Research)