TinyLlama on Apple M1 · 8GB

✅ Runs (tight) — TinyLlama 1.1B @ FP16
TinyLlama 1.1B at FP16 needs ~2.7 GB (weights 2.0 GB + KV 176 MB + overhead 512 MB @ 8K ctx) of your 2.9 GB usable (of 8.0 GB unified memory) — fits, but little headroom — close other apps or trim context. Expect ~17–30 tok/s (fast).
context @ FP16: runs to its full 2K
quantneedsspeed
✓ FP162.7 GB~17–30 tok/s (fast)
✓ Q8_01.8 GB~30–50 tok/s (fast)
✓ Q4_K_M1.3 GB~50–85 tok/s (very fast)
$runlocal install tinyllama:1.1b
runlocal verdict card
download card share on x share on reddit drop it in your model-drop post
TinyLlama: Runs (tight)
for your own README — links back here

Same model, other machines: Apple M1 Pro · Apple M2 · Apple M3 Pro · Apple M2 Pro · Apple M4 Pro · Apple M3 Max

Also runs on a Apple M1: DeepSeek-R1 (distill) · Qwen2.5 · Qwen3 · Llama 3.2 · Gemma 2

Best models for a Apple M1 · 8GB →

Check any combo yourself: open the checker →