@@ -62,147 +62,7 @@ ______________________________________________________________________
6262
6363## Supported Models
6464
65- The following table summarizes the models that have been trained end-to-end by our team as well as others in the roadmap:
66-
67- <table >
68- <thead >
69- <tr >
70- <th >Verifier Architecture</th >
71- <th >Verifier Size</th >
72- <th >Training Support</th >
73- <th >vLLM Deployment Support</th >
74- </tr >
75- </thead >
76- <tbody >
77- <tr >
78- <td rowspan =" 2 " >Llama</td >
79- <td >8B-Instruct</td >
80- <td ><a href =" https://huggingface.co/RedHatAI/Llama-3.1-8B-Instruct-speculator.eagle3 " >EAGLE-3</a > ✅</td >
81- <td >✅</td >
82- </tr >
83- <tr >
84- <td >70B-Instruct</td >
85- <td ><a href =" https://huggingface.co/RedHatAI/Llama-3.3-70B-Instruct-speculator.eagle3 " >EAGLE-3</a > ✅</td >
86- <td >✅</td >
87- </tr >
88- <tr >
89- <td rowspan =" 3 " >Qwen3</td >
90- <td >8B</td >
91- <td ><a href =" https://huggingface.co/RedHatAI/Qwen3-8B-speculator.eagle3 " >EAGLE-3</a > ✅<br /><a href =" https://huggingface.co/RedHatAI/Qwen3-8B-speculator.dflash " >DFlash</a > ✅<br /><a href =" https://huggingface.co/RedHatAI/Qwen3-8B-speculator.peagle " >P-EAGLE</a > ✅</td >
92- <td >✅</td >
93- </tr >
94- <tr >
95- <td >14B</td >
96- <td ><a href =" https://huggingface.co/RedHatAI/Qwen3-14B-speculator.eagle3 " >EAGLE-3</a > ✅</td >
97- <td >✅</td >
98- </tr >
99- <tr >
100- <td >32B</td >
101- <td ><a href =" https://huggingface.co/RedHatAI/Qwen3-32B-speculator.eagle3 " >EAGLE-3</a > ✅</td >
102- <td >✅</td >
103- </tr >
104- <tr >
105- <td rowspan =" 2 " >gpt-oss</td >
106- <td >20b</td >
107- <td ><a href =" https://huggingface.co/RedHatAI/gpt-oss-20b-speculator.eagle3 " >EAGLE-3</a > ✅</td >
108- <td >✅</td >
109- </tr >
110- <tr >
111- <td >120b</td >
112- <td ><a href =" https://huggingface.co/RedHatAI/gpt-oss-120b-speculator.eagle3 " >
113- EAGLE-3
114- </a> ✅</td>
115- <td >✅</td >
116- </tr >
117- <tr >
118- <td rowspan =" 4 " >Qwen3 MoE</td >
119- <td >30B-Instruct</td >
120- <td ><a href =" https://huggingface.co/RedHatAI/Qwen3-30B-A3B-Instruct-2507-speculator.eagle3 " >
121- EAGLE-3
122- </a> ✅<br/><a href="https://huggingface.co/RedHatAI/Qwen3-30B-A3B-Instruct-2507-speculator.dflash">DFlash</a> ✅</td>
123- <td >✅</td >
124- </tr >
125- <tr >
126- <td >30B</td >
127- <td ><a href =" https://huggingface.co/RedHatAI/Qwen3-30B-A3B-speculator.dflash " >DFlash</a > ✅</td >
128- <td >✅</td >
129- </tr >
130- <tr >
131- <td >235B-Instruct</td >
132- <td >
133- <a href="https://huggingface.co/RedHatAI/Qwen3-235B-A22B-Instruct-2507-speculator.eagle3">
134- EAGLE-3
135- </a> ✅
136- </td >
137- <td >✅</td >
138- </tr >
139- <tr >
140- <td >235B</td >
141- <td ><a href =" https://huggingface.co/RedHatAI/Qwen3-235B-A22B-speculator.eagle3 " >
142- EAGLE-3
143- </a> ✅</td>
144- <td >✅</td >
145- </tr >
146- <tr >
147- <td >Qwen3-VL</td >
148- <td >235B-A22B</td >
149- <td ><a href =" https://huggingface.co/RedHatAI/Qwen3-VL-235B-A22B-Instruct-speculator.eagle3 " >
150- EAGLE-3
151- </a> ✅</td>
152- <td >✅</td >
153- </tr >
154- <tr >
155- <td >Mistral Small 4</td >
156- <td >119B</td >
157- <td ><a href =" https://huggingface.co/RedHatAI/Mistral-Small-4-119B-2603.dflash " >DFlash</a > ✅<br /><a href =" https://huggingface.co/RedHatAI/Mistral-Small-4-119B-2603-speculator.dspark " >DSpark</a > ✅</td >
158- <td >✅</td >
159- </tr >
160- <tr >
161- <td >Gemma 4</td >
162- <td >31B-it</td >
163- <td ><a href =" https://huggingface.co/RedHatAI/gemma-4-31B-it-speculator.eagle3 " >EAGLE-3</a > ✅<br /><a href =" https://huggingface.co/RedHatAI/gemma-4-31B-it-speculator.dflash " >DFlash</a > ✅</td >
164- <td >✅</td >
165- </tr >
166- <tr >
167- <td >Gemma 4 MoE</td >
168- <td >26B-A4B-it</td >
169- <td ><a href =" https://huggingface.co/RedHatAI/gemma-4-26B-A4B-it-speculator.eagle3 " >EAGLE-3</a > ✅</td >
170- <td >✅</td >
171- </tr >
172- <tr >
173- <td >NVIDIA Nemotron 3 Ultra</td >
174- <td >550B-A55B</td >
175- <td ><a href =" https://huggingface.co/RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-speculator.dflash " >DFlash</a > ✅</td >
176- <td >✅</td >
177- </tr >
178- <tr >
179- <td >NVIDIA Nemotron 3 Super</td >
180- <td >120B-A12B</td >
181- <td ><a href =" https://huggingface.co/RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-speculator.dflash " >DFlash</a > ✅</td >
182- <td >✅</td >
183- </tr >
184- <tr >
185- <td >Kimi K3</td >
186- <td >-</td >
187- <td ><a href =" https://huggingface.co/RedHatAI/Kimi-K3-speculator.dspark " >DSpark</a > ✅</td >
188- <td >✅</td >
189- </tr >
190- <tr >
191- <td >Qwen3.6 MoE</td >
192- <td >35B-A3B</td >
193- <td ><a href =" https://huggingface.co/RedHatAI/Qwen3.6-35B-A3B-speculator.dspark " >DSpark</a > ✅</td >
194- <td >✅</td >
195- </tr >
196- <tr >
197- <td >GLM 5.2</td >
198- <td >-</td >
199- <td ><a href =" https://huggingface.co/RedHatAI/GLM-5.2-speculator.dspark " >DSpark</a > ✅</td >
200- <td >✅</td >
201- </tr >
202- </tbody >
203- </table >
204-
205- ✅ = Supported, ⏳ = In Progress, ❌ = Not Yet Supported
65+ Browse trained speculators and their evaluation results on the [ Speculators dashboard] ( https://neuralmagic.github.io/speculators-dashboard/ ) .
20666
20767## vLLM Inference
20868
0 commit comments