latent.fs / tags / Ollama — 2 items

/feed.xml

TAG

#Ollama

2026-07 1 post

  1. Wiring codex to a Local Qwen — ollama, vLLM, and the developer role

    Point codex CLI at a local model on ollama or vLLM. ollama needs one config.toml; vLLM rejects the developer role, fixed by a template patch or a proxy.

    AI·Agent #32

2026-05 1 post

  1. Apple Silicon LLM Inference — Five Backends Compared

    Qwen3.5-9B on MLX, llama.cpp, Ollama, omlx, and vLLM Metal. MLX led single requests at 25 tok/s; only omlx batched concurrent requests.

    AI·Infra #13

TAGS 190

All 190 tags →