The smallest-memory cataloged machine that runs Llama 3.3 on the GPU is a NVIDIA GeForce RTX 5090 · 32GB VRAM. Here are the rigs that fit it, smallest memory first.
| machine | best fit | verdict | speed |
|---|---|---|---|
| NVIDIA GeForce RTX 5090 · 32GB VRAM | 70B Q2_K | ✅ Runs (tight) | 30–45 tok/s |
| AMD Radeon Pro W7900 · 48GB VRAM | 70B Q3_K_M | ✅ Runs (tight) | 10–16 tok/s |
| Apple M3 Max · 48GB | 70B Q2_K | ✅ Runs (tight) | 7–11 tok/s |
| Apple M4 Max · 48GB | 70B Q2_K | ✅ Runs (tight) | 9–14 tok/s |
| Apple M4 Pro · 48GB | 70B Q2_K | ✅ Runs (tight) | 5–9 tok/s |
| Apple M1 Max · 64GB | 70B Q4_K_M | ✅ Runs (tight) | 4–7 tok/s |
| Apple M1 Ultra · 64GB | 70B Q4_K_M | ✅ Runs (tight) | 7–12 tok/s |
| Apple M2 Max · 64GB | 70B Q4_K_M | ✅ Runs (tight) | 4–7 tok/s |
| Apple M2 Ultra · 64GB | 70B Q4_K_M | ✅ Runs (tight) | 7–12 tok/s |
| Apple M2 Max · 96GB | 70B Q5_K_M | ✅ Runs comfortably | 4–6 tok/s |
| Apple M2 Ultra · 128GB | 70B Q8_0 | ✅ Runs (tight) | 4–7 tok/s |
| Apple M3 Max · 128GB | 70B Q8_0 | ✅ Runs (tight) | 2–4 tok/s |
Already have a machine? See Llama 3.3 across popular rigs → or check your exact rig →
Planning a whole workflow? Rigs for a coding agent · local chat · reasoning · local RAG setup.
Verdicts use the same GQA-aware fit math as the CLI — a NVIDIA GeForce RTX 5090 verdict here matches what runlocal tells you on the machine.