Can My PC Run a Local LLM? VRAM & RAM Calculator

Pick your GPU or enter your VRAM, system RAM, and target context length (8K–128K). Get an instant quantization verdict, KV-cache memory estimate, expected tok/s, and local cost vs API break-even.

Yes — your hardware can run Qwen3.8-Flash-Next locally.

Recommended quant
Q2_0
Expected write speed
130.1 tok/s (measured)
KV cache allowance
~4 GB (32K)
Local unit cost
$0.102/M
Est. break-even
1104 days
QuantizationVerdictVRAMSystem RAMDownloadEst. write
Q2_0
Fastest quant; great for 48 GB RAM systems.
Recommended15 GB51 GB~70 GB~130.1 tok/s
IQ2_XS
Recommended default for 64 GB RAM; balance of speed and quality.
Needs more RAM15 GB67 GB~72 GB—
IQ3_XXS
Smarter than IQ2; still fits most 64 GB builds.
Needs more RAM15 GB67 GB~74 GB—
IQ3_S
Best quality that still runs on 64 GB; slowest of the IQ line.
Needs more RAM15 GB67 GB~76 GB—
Coder
Coding-focused variant; fits 32 GB RAM (weaker on CJK general text).
Fits15 GB35 GB~68 GB~76.1 tok/s
Unsloth UD-IQ4_XS
~4-bit Unsloth pack; needs ~80 GB RAM or partial SSD offload.
Needs more RAM15 GB83 GB~94 GB—

Quick reference: what each VRAM & RAM tier can run (at 32K context)

Every row is computed directly from the same quantization floors and KV-cache rules as the interactive calculator above.

Hardware tierGPU VRAM / Unified MemorySystem RAMRecommended quantEst. write
RTX 4060 8GB / RTX 30708 GB32 GBNeeds 12 GB+ VRAM—
RTX 4070 / RTX 5070 12GB (32 GB RAM)12 GB32 GBNeeds 12 GB+ VRAM—
RTX 4070 / RTX 5070 12GB (64 GB RAM)12 GB64 GBQ2_0~76 tok/s
RTX 5080 / RTX 5070 Ti / RX 9070 XT 16GB16 GB64 GBQ2_0~108.5 tok/s
RTX 4090 / RTX 3090 / RX 7900 XTX24 GB64 GBQ2_0~113.9 tok/s
RTX 5090 / 2× RTX 5060 Ti 16GB32 GB96 GBUnsloth UD-IQ4_XS~97 tok/s
Mac Studio M5 Max / Mac mini M5 Pro 64 GB64 GB*64 GBCoder~36.1 tok/s
Ryzen AI Max+ 395 / DGX Spark / Mac Studio 128 GB+128 GB*128 GBUnsloth UD-IQ4_XS~43.3 tok/s

* Unified memory shares one pool with the OS (~82% usable for model + KV cache). Best → · Benchmarks → · GPUs → · Method →

FAQ

What is the minimum GPU VRAM and RAM to run Strata locally?
You need at least 12 GB GPU VRAM and 32 GB system RAM for the Coder build, or 12 GB VRAM + 64 GB RAM for the recommended IQ2_XS default build.
Can an 8 GB GPU like an RTX 4060 run Qwen3.8-Flash-Next?
No — 8 GB discrete VRAM sits below the 12 GB minimum floor for Qwen3.8-Flash-Next builds. Moving to a 12 GB or 16 GB card (such as RTX 4070, RTX 5070, or RX 9070 XT) unlocks local runs.
How much extra memory does 128K context require?
Long 128K context adds roughly 14 GB of KV-cache memory overhead compared to ~1.5 GB at 8K context, so 64 GB–96 GB system RAM (or 128 GB unified memory) is recommended for heavy 128K workloads.
Is Apple Silicon unified memory faster or slower than an RTX 4090?
Apple Silicon holds much larger models in one quiet unified pool (64–512 GB), while discrete NVIDIA cards like the RTX 4090 (109.3 tok/s) and RTX 5090 (168.4 tok/s) generate tokens 2–5× faster.