latent.fs / tags / Qwen — 2 items

/feed.xml

TAG

#Qwen

2026-07 1 post

  1. Wiring codex to a Local Qwen — ollama, vLLM, and the developer role

    Point codex CLI at a local model on ollama or vLLM. ollama needs one config.toml; vLLM rejects the developer role, fixed by a template patch or a proxy.

    AI·Agent #32

2026-06 1 post

  1. Speeding up LLM inference with MTP and diffusion

    Gemma 4 and Qwen 3.6 on one H100 at fp8: MTP ran 1.43–2.62x faster with GPQA accuracy effectively unchanged; diffusion was ~4x faster but less accurate.

    AI·Inference #31

TAGS 190

All 190 tags →