Runs on Data centre · Hugging Face ↗
Coding index 68.8 (Artificial Analysis)
A very large MoE and one of the highest-scoring open coding models. The weights are open, but running it is a multi-node affair.
Real GGUF file sizes = weight VRAM. Add the KV cache for your context (≈4 GB at 32K, fp16).
| Quantization | Size |
|---|---|
| Q4 | 849.7 GB |
| Q8 | 873.4 GB |
Hundreds of GB even at Q4 — tensor / pipeline parallel across many GPUs with vLLM or SGLang. For anything short of a cluster, rent it per token (leaderboard).