TAG
#LLM
2026-10 1 post
-
Minority Responses in Persona-Prompted LLMs: Following Architect of Silence
The representation problem raised by Architect of Silence, followed by the design, findings, and limits of independent checks and exploratory follow-up experiments.
2026-07 1 post
-
Wiring codex to a Local Qwen — ollama, vLLM, and the developer role
Point codex CLI at a local model on ollama or vLLM. ollama needs one config.toml; vLLM rejects the developer role, fixed by a template patch or a proxy.
2026-06 1 post
-
Speeding up LLM inference with MTP and diffusion
Gemma 4 and Qwen 3.6 on one H100 at fp8: MTP ran 1.43–2.62x faster with GPQA accuracy effectively unchanged; diffusion was ~4x faster but less accurate.
2026-05 5 posts
-
Harness as Environment
A vector DB full of experience does not make an agent adapt. That takes a harness: what may change, how success is judged, how far a failure rolls back.
-
Weights, Prompts, Codes as Parameters
If agent problems are POMDPs, weights, prompts, and code are parameters at three layers of one policy space. Why the layers opened in that order.
-
Apple Silicon LLM Inference — Five Backends Compared
Qwen3.5-9B on MLX, llama.cpp, Ollama, omlx, and vLLM Metal. MLX led single requests at 25 tok/s; only omlx batched concurrent requests.
-
Long-Context Evaluation — NIAH and Lost in the Middle
NIAH limits, the Lost in the Middle effect, alternative benchmarks, and measured recall across four reasoning-effort modes
-
NVIDIA NIM API — Free Inference for GLM, Kimi, Nemotron, and Gemma 4
build.nvidia.com serves 100+ open models via a free OpenAI-compatible API, no credit card, up to 40 RPM per model. Setup for Claude Code and Cursor.
No matching posts.