What hardware runs Qwen2.5?

The cheapest cataloged machine that runs Qwen2.5 on the GPU is a AMD Radeon RX 7600 · 8GB VRAM. Here are the most affordable rigs that fit it, smallest memory first.

machinebest fitverdictspeed
AMD Radeon RX 7600 · 8GB VRAM 7B Q6_K ✅ Runs (tight) 17–30 tok/s
Apple M1 · 8GB 3B Q5_K_M ✅ Runs (tight) 16–25 tok/s
Apple M2 · 8GB 3B Q5_K_M ✅ Runs (tight) 25–40 tok/s
Apple M3 · 8GB 3B Q5_K_M ✅ Runs (tight) 25–40 tok/s
NVIDIA GeForce RTX 3070 · 8GB VRAM 7B Q6_K ✅ Runs (tight) 30–45 tok/s
NVIDIA GeForce RTX 4060 · 8GB VRAM 7B Q6_K ✅ Runs (tight) 17–30 tok/s
NVIDIA GeForce RTX 3080 · 10GB VRAM 14B Q3_K_M ✅ Runs (tight) 35–60 tok/s
AMD Radeon RX 6700 XT · 12GB VRAM 14B Q4_K_M ✅ Runs (tight) 14–25 tok/s
AMD Radeon RX 7700 XT · 12GB VRAM 14B Q4_K_M ✅ Runs (tight) 16–25 tok/s
NVIDIA GeForce RTX 3060 · 12GB VRAM 14B Q4_K_M ✅ Runs (tight) 14–25 tok/s
NVIDIA GeForce RTX 4070 · 12GB VRAM 14B Q4_K_M ✅ Runs (tight) 20–35 tok/s
AMD Radeon RX 6800 XT · 16GB VRAM 14B Q5_K_M ✅ Runs (tight) 17–30 tok/s

Minimum rig by size

The smallest cataloged machine that runs each size on the GPU (default 8K context). Bigger sizes need more memory — a rig that runs the small one may not touch the large.

sizeminimum rigverdictspeed
72B AMD Radeon Pro W7900 · 48GB VRAM ✅ Runs (tight) ~9–15 tok/s (usable)
32B AMD Radeon RX 7900 XT · 20GB VRAM ✅ Runs (tight) ~17–30 tok/s (fast)
14B NVIDIA GeForce RTX 3080 · 10GB VRAM ✅ Runs (tight) ~35–60 tok/s (fast)
7B AMD Radeon RX 7600 · 8GB VRAM ✅ Runs (tight) ~17–30 tok/s (fast)
3B AMD Radeon RX 7600 · 8GB VRAM ✅ Runs comfortably ~35–55 tok/s (fast)
1.5B AMD Radeon RX 7600 · 8GB VRAM ✅ Runs comfortably ~35–60 tok/s (fast)
0.5B AMD Radeon RX 7600 · 8GB VRAM ✅ Runs comfortably ~110–180 tok/s (very fast)

Already have a machine? See Qwen2.5 across popular rigs → or check your exact rig →

Planning a whole workflow? Rigs for a coding agent · local chat · reasoning · local RAG setup.

$npx runlocal-sh can-i-run qwen2.5 --hardware <your-rig>

Verdicts use the same GQA-aware fit math as the CLI — a AMD Radeon RX 7600 verdict here matches what runlocal tells you on the machine.