Qwen3.5 4B

Coding index 22.6 (Artificial Analysis)

A dense 4B with a thinking mode — a surprisingly capable reasoner at a size that fits almost anything, phone included.

HumanEval pass@1 33% (10/30), via local GPU (Ollama, Q4_K_M). Measured by us on this hardware, as a rough sanity check — HumanEval is a different, easier, partly-contaminated benchmark than Artificial Analysis’ composite, so it is not comparable to the coding-index column. Reasoning model truncated at 2.5K tokens on 22/30 problems — a floor, not its ceiling.

BigCodeBench-Hard pass@1 12% (14/121), via local GPU (Ollama, num_ctx 16384, budget 12K). The brutal counterpart to HumanEval — where HumanEval saturates near the top, BCB-Hard spreads the field, so this is the number that actually separates coding ability. Comparable full-148 run at 16K context. Still verbose — 36/148 hit the 12K budget — so treat as a near-floor.

~71 tok/s on RTX 4060 Ti, measured by us.

Under 5 GB at Q4. Great as a fast draft / autocomplete model; toggle thinking off for latency. Runs well on Apple Silicon via MLX.