Skip to content

[Spec Decode] Add draft-model distributions for probabilistic sampling - #1373

Draft
POWEHI2023 wants to merge 1 commit into
vllm-project:mainfrom
POWEHI2023:feat/lossless-speculative-sampling
Draft

POWEHI2023 wants to merge 1 commit into
vllm-project:mainfrom
POWEHI2023:feat/lossless-speculative-sampling

Enable probabilistic draft-model speculative decoding

77eae6a
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Nov 19, 2026 in 1s

DCO

All commits are signed off!