Model Spend Arena2ND ED.
124B · MoE · 262,144 ctx · 2026-10-03

Ling-3.0-flash

Runs on — · Hugging Face ↗

vLLMSGLang

AA coding index 57.0 (Artificial Analysis, frozen since 2026-09-11)

inclusionAI's open MoE (Ling 3.0; 124B total, 5.1B active, hybrid reasoning on by default). AA now scores it — coding index 50.6 — and our first-party BCB-Hard (36%) confirms it punches above its active size. Free in opencode Zen's rotating set; on OpenRouter the :free route rotated over to Ling 3.0 Tiny, so flash is paid-only there now ($0.08/$0.22 per M).

First-party test · not the AA coding index

BigCodeBench-Hard pass@1 25% (37/148), via official protocol · llama.cpp Q4_K_M · one request at a time · a shared cluster GPU · mean of 3 runs, range 0.0 pp. The brutal counterpart to HumanEval — where HumanEval saturates near the top, BCB-Hard spreads the field, so this is the number that actually separates coding ability.

What we measured

Our own runs on this model. Each number carries how many problems it is over and how many times we ran it — these are not comparable with each other, and none of them is on the same scale as the third-party indices on the leaderboard.

testscoreoverconditions
BigCodeBench-Hard25.0%n=148 · 3 run(s)official protocol · llama.cpp Q4_K_M · one request at a time · a shared cluster GPU · mean of 3 runs, range 0.
BFCL v4 non-live88.2% ± 2.1n=1390 · 1 run(s)BFCL v4 · Q4_K_M GGUF via llama.cpp · one request at a time · a shared cluster GPU
Tool use · BFCL v4 non-live · first-party

88.2% ± 2.1 over 1390 problems

Q4_K_M · a shared cluster GPU · KV f16 · 1 run. This is the non-agentic half of BFCL: does the model call the right function with the right arguments. It says nothing about how it behaves over a long agentic conversation, which is a separate measurement. The score is BFCL’s own: the unweighted mean of four groups (simple, multiple, parallel, parallel multiple), where simple is itself the mean of Python, Java and JavaScript. Every group counts the same whatever its size, and irrelevance detection — which we also measure, another 240 problems — is not part of it. The margin follows that same weighting.

Sizes on disk

Real GGUF file sizes = weight VRAM.

QuantizationSize
IQ1_S28.1 GB
IQ1_M31.3 GB
IQ2_XXS36.7 GB
IQ2_XS38.6 GB
IQ2_S41.0 GB
IQ2_M45.3 GB
Q2_K47.8 GB
IQ3_XXS53.9 GB
IQ3_XS56.8 GB
Q3_K_S56.8 GB
Q3_K_M59.8 GB
Q3_K_L63.3 GB
IQ3_M67.6 GB
IQ4_XS69.4 GB
Q4_071.1 GB
Q4_K_S74.0 GB
Q4_178.5 GB
Q4_K_M78.7 GB
IQ4_NL78.7 GB
Q4_K_L84.9 GB
Q5_K_S89.0 GB
Q5_K_M95.9 GB
Q6_K_S104.6 GB
Q6_K109.7 GB
Q8_0132.4 GB
BF16248.9 GB

Config tips

~70 GB at Q4 — a single 80 GB card or a 2-GPU split; community GGUFs exist but are days old and unvetted. We tested it hosted, back when it rode the OpenRouter <code>:free</code> route.