CATEGORY
AI / Inference
2026-06 1 post
-
Speeding up LLM inference with MTP and diffusion
Gemma 4 and Qwen 3.6 on one H100 at fp8: MTP ran 1.43–2.62x faster with GPQA accuracy effectively unchanged; diffusion was ~4x faster but less accurate.
No matching posts.