Local LLM model fit
Qwen3-Coder 30B-A3B is a 30B Qwen3-Coder model. This page estimates Q4 VRAM fit, Ollama command, context planning, and fallback choices for common local AI GPUs.
Agentic coding, repository-scale local code review, and tool-heavy development loops. Weakness: Long context leaves little headroom on single 24GB GPUs.
| Hardware | Examples | Clean capacity | Q4 need | Status | Calculator |
|---|---|---|---|---|---|
| 6 GB VRAM entry GPU | GTX 1660, RTX 2060 6GB | 4.50 GB clean VRAM | 19 GB | RAM offload | Open calculator |
| 8 GB VRAM mainstream GPU | RTX 3060 Ti, RTX 4060, RTX 3070 | 6.50 GB clean VRAM | 19 GB | RAM offload | Open calculator |
| 10 GB VRAM older high-end GPU | RTX 3080 10GB | 8.50 GB clean VRAM | 19 GB | RAM offload | Open calculator |
| 12 GB VRAM local agent GPU | RTX 3060 12GB, RTX 4070 | 10.5 GB clean VRAM | 19 GB | RAM offload | Open calculator |
| 16 GB VRAM creator GPU | RTX 4060 Ti 16GB, RTX 4080 | 14.5 GB clean VRAM | 19 GB | RAM offload | Open calculator |
| 24 GB VRAM homelab workstation | RTX 3090, RTX 4090 | 22.5 GB clean VRAM | 19 GB | Runs locally | Open calculator |
| 48 GB VRAM workstation | RTX A6000, L40S 48GB | 46.5 GB clean VRAM | 19 GB | Runs locally | Open calculator |
| Apple Silicon 32 GB unified memory | M2 Max 32GB, M3 Max 36GB | 26 GB unified | 19 GB | Runs locally | Open calculator |
| Quantization | Estimated memory | Use case |
|---|---|---|
| Q4 / 4-bit | 19 GB | Default local inference balance |
| Q5 / 5-bit | 23.8 GB | Better quality, more VRAM |
| Q8 / 8-bit | 38 GB | High quality, much more VRAM |
| FP16 / 16-bit | 76 GB | Mostly workstation/server use |
27B · 24GB-class multimodal agent, coding assistant, and reasoning workloads
27B · High-quality multimodal local assistant on 24GB GPUs
24B · Software engineering agents, repo navigation, patch planning, and local coding workflows
20B · Local reasoning, agent planning, and tool-use workflows on 16GB+ GPUs