▲ runlocal graph

whole catalog

152 nodes · 505 edges

legend click to toggle

god nodes

Q8_0 36Q4_K_M 35Q5_K_M 28chat 26general 228kv/128hd 20

surprising connections

Code Llama 13B ~40kv/128hd~ LLaVA 13B
Code Llama 34B ~8kv/128hd~ Codestral 22B
Code Llama 34B ~8kv/128hd~ DeepSeek-R1 (distill) 14B
Code Llama 34B ~8kv/128hd~ Granite 3.1 8B
Code Llama 34B ~8kv/128hd~ Llama 3.1 70B
Code Llama 34B ~8kv/128hd~ Mistral 7B

questions to explore

Which models offer Q8_0, the catalog's most universal quant?
Why do Code Llama 13B and LLaVA 13B share the same KV-cache geometry?
What's the smallest model that still fits my rig comfortably?
Which quant gives the best speed-vs-quality trade-off on my hardware?

drag a node · scroll to zoom · drag the canvas to pan · generated by runlocal graph