| quant | needs | speed |
|---|---|---|
| ✓ Q8_0 | 1.7 GB | ~35–55 tok/s (fast) |
| ✓ Q4_K_M | 1.3 GB | ~50–85 tok/s (very fast) |
Same model, other machines: Apple M1 Pro · Apple M2 · Apple M3 Pro · Apple M2 Pro · Apple M4 Pro · Apple M3 Max
Also runs on a Apple M1: DeepSeek-R1 (distill) · Qwen2.5 · Qwen3 · Llama 3.2 · Gemma 2
Best models for a Apple M1 · 8GB →
These share Gemma 3's KV-cache geometry — they size memory the same way, so here's how they fit on a Apple M1 · 8GB too:
| model | shares | verdict here |
|---|---|---|
| Gemma 4 | 8kv/256hd | ❌ Won't fit |
| Falcon3 7B | 4kv/256hd | 🐢 CPU-only (slow) |
Check any combo yourself: open the checker →