Can I run Qwen2.5-Coder?

Best open coding model class. The 32B rivals proprietary coders; 7B/14B fit most rigs.

codingagents · sizes: 1.5B, 7B, 14B, 32B · Apache-2.0

What runs it

machine	best fit	verdict	speed
Apple M1 · 8GB	1.5B Q8_0	✅ Runs comfortably	25–40 tok/s
Apple M1 Pro · 16GB	7B Q6_K	✅ Runs (tight)	16–25 tok/s
Apple M2 · 16GB	7B Q6_K	✅ Runs (tight)	9–15 tok/s
Apple M3 Pro · 18GB	14B Q3_K_M	✅ Runs (tight)	9–16 tok/s
Apple M2 Pro · 32GB	32B Q3_K_M	✅ Runs (tight)	6–10 tok/s
Apple M4 Pro · 48GB	32B Q5_K_M	✅ Runs comfortably	6–10 tok/s
Apple M3 Max · 36GB	32B Q3_K_M	✅ Runs (tight)	10–17 tok/s
Apple M2 Max · 64GB	32B Q8_0	✅ Runs (tight)	5–8 tok/s
Apple M4 Max · 128GB	32B Q8_0	✅ Runs comfortably	6–11 tok/s
Apple M2 Ultra · 192GB	32B Q8_0	✅ Runs comfortably	7–11 tok/s
NVIDIA GeForce RTX 3060 · 12GB VRAM	14B Q4_K_M	✅ Runs (tight)	14–25 tok/s
NVIDIA GeForce RTX 4070 · 12GB VRAM	14B Q4_K_M	✅ Runs (tight)	20–35 tok/s
NVIDIA GeForce RTX 4090 · 24GB VRAM	32B Q4_K_M	✅ Runs (tight)	19–30 tok/s
NVIDIA GeForce RTX 5080 · 16GB VRAM	14B Q5_K_M	✅ Runs (tight)	35–55 tok/s
NVIDIA GeForce RTX 5090 · 32GB VRAM	32B Q5_K_M	✅ Runs (tight)	30–50 tok/s
AMD Radeon RX 7900 XTX · 24GB VRAM	32B Q4_K_M	✅ Runs (tight)	17–30 tok/s