Qwen3 30B-A3B (2507) hardware requirements

About the model

Parameters: 30.5B total · 3.3B active (MoE)
Attention: Full attention
Max context: 262,144 tokens
Released: 2025-07-31
Model card: Qwen3 30B-A3B (2507) on Hugging Face

GGUF files

Tracked quantizations of Qwen3 30B-A3B (2507), smallest first
Quant	File size	Quality	Published by
Q2_K	11.26 GB	Heavy loss	Community GGUF · unsloth
IQ4_XS	16.38 GB	Good balance	Community GGUF · unsloth
Q4_K_Mbaseline	18.56 GB	Good balance	Community GGUF · unsloth
Q8_0	32.48 GB	Near-lossless	Community GGUF · unsloth

Some repositories publish only Unsloth Dynamic (UD) variants; sizes are those of the file you would download.

Memory needed by quant and context

Weights + f16 KV cache + compute buffer, in GB. Add about 0.6 GB if the GPU also drives your display on Windows.
Quant	4k	8k	16k	32k	64k	128k	256k
Q2_K	12.2	12.6	13.5	15.3	18.8	25.8	39.9
IQ4_XS	17.3	17.8	18.6	20.4	23.9	31.0	45.0
Q4_K_M	19.5	19.9	20.8	22.6	26.1	33.1	47.2
Q8_0	33.4	33.9	34.7	36.5	40.0	47.1	61.1

Which GPUs can run Qwen3 30B-A3B (2507)?

How to read the verdicts

Runs great: Fully on the GPU at 20 tok/s or more
Runs well: Fully on the GPU at 8–20 tok/s; MoE experts in system RAM at 20 tok/s or more; or at least 90% on the GPU at 8 tok/s or more
Runs slowly: 2–8 tok/s; CPU-only; less than 90% on the GPU; or MoE experts in system RAM below 20 tok/s
Won't run: Does not fit, or under 2 tok/s

Sort

Scroll sideways to see every column.

54 GPUs, Macs and CPU setups at Q4_K_M with 8k context, sorted by verdict and speed
Hardware	Verdict	Speed	Quant	Memory	Runs as	Context	Notes	Price
GeForce RTX 5090	Runs greatDetails	est. 235.0 tok/s188.0–282.0calibrated estimate ±20%	Q4_K_M	20.5 / 32.0 GB	Full GPU	up to 64k	—	$4,200 street (as of 2026-08-09)
Radeon RX 7900 XTX	Runs great	est. 170.6 tok/s136.5–204.7calibrated estimate ±20%	Q4_K_M	20.5 / 24.0 GB	Full GPU	up to 32k	—	$999 launch MSRP
GeForce RTX 3090 Ti	Runs great	est. 161.2 tok/s129.0–193.5calibrated estimate ±20%	Q4_K_M	20.5 / 24.0 GB	Full GPU	up to 32k	—	$1,999 launch MSRP
GeForce RTX 4090	Runs greatDetails	est. 161.2 tok/s129.0–193.5calibrated estimate ±20%	Q4_K_M	20.5 / 24.0 GB	Full GPU	up to 32k	—	$2,755 street (as of 2026-08-09)
GeForce RTX 3090	Runs greatDetails	est. 149.7 tok/s119.8–179.7calibrated estimate ±20%	Q4_K_M	20.5 / 24.0 GB	Full GPU	up to 32k	—	$1,050 street (as of 2026-08-09)
GeForce RTX 5090 Laptop	Runs great	est. 143.3 tok/s114.6–172.0calibrated estimate ±20%	Q4_K_M	20.5 / 24.0 GB	Full GPU	up to 32k	—	—
Apple M3 Ultra · 96 GB	Runs great	est. 84.4 tok/s67.5–101.3calibrated estimate ±20%	Q4_K_M	19.9 / 67.2 GB	Unified memory	up to 64k	—	—
Apple M2 Ultra · 64 GB	Runs great	est. 82.5 tok/s66.0–99.0calibrated estimate ±20%	Q4_K_M	19.9 / 44.8 GB	Unified memory	up to 64k	—	—
Apple M5 Max (40-core GPU) · 48 GB	Runs great	est. 65.5 tok/s52.4–78.6calibrated estimate ±20%	Q4_K_M	19.9 / 33.6 GB	Unified memory	up to 64k	—	—
Apple M4 Max (40-core GPU) · 48 GB	Runs great	est. 58.2 tok/s46.6–69.9calibrated estimate ±20%	Q4_K_M	19.9 / 33.6 GB	Unified memory	up to 32k	—	—
Apple M5 Max (32-core GPU) · 36 GB	Runs great	est. 49.1 tok/s39.2–58.9calibrated estimate ±20%	Q4_K_M	19.9 / 25.2 GB	Unified memory	up to 32k	—	—
Ryzen AI Max+ 395 (Strix Halo) · 32 GB	Runs great	est. 48.2 tok/s38.6–57.9calibrated estimate ±20%	Q4_K_M	19.9 / 22.4 GB	Unified memory	up to 16k	—	$1,999 launch MSRP
Apple M4 Max (32-core GPU) · 36 GB	Runs great	est. 43.7 tok/s35.0–52.5calibrated estimate ±20%	Q4_K_M	19.9 / 25.2 GB	Unified memory	up to 32k	—	—
NVIDIA DGX Spark · 128 GB	Runs great	est. 38.8 tok/s31.1–46.6calibrated estimate ±20%	Q4_K_M	19.9 / 89.6 GB	Unified memory	up to 32k	—	$3,999 launch MSRP
Apple M5 Pro · 48 GB	Runs great	est. 32.7 tok/s26.2–39.3calibrated estimate ±20%	Q4_K_M	19.9 / 33.6 GB	Unified memory	up to 16k	—	—
Apple M4 Pro · 48 GB	Runs greatDetails	est. 29.1 tok/s23.3–34.9calibrated estimate ±20%	Q4_K_M	19.9 / 33.6 GB	Unified memory	up to 16k	—	—
Apple M5 · 32 GB	Runs well	est. 16.4 tok/s13.1–19.7calibrated estimate ±20%	Q4_K_M	19.9 / 22.4 GB	Unified memory	up to 16k	Q2_K (heavy quality loss): Runs great	—
Apple M4 · 32 GB	Runs wellDetails	est. 12.8 tok/s10.2–15.4calibrated estimate ±20%	Q4_K_M	19.9 / 22.4 GB	Unified memory	up to 16k	—	—
Intel Arc B580	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 12.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$290 street (as of 2026-08-09)
GeForce GTX 1080 Ti	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 11.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$699 launch MSRP
GeForce RTX 2080 Ti	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 11.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$999 launch MSRP
GeForce RTX 3050 8GB	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 8.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 32k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$249 launch MSRP
GeForce RTX 3060 12GB	Runs slowlyDetails	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 12.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$250 street (as of 2026-08-09)
GeForce RTX 3070	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 8.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 32k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$499 launch MSRP
GeForce RTX 3080 10GB	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 10.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$699 launch MSRP
GeForce RTX 3080 12GB	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 12.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$799 launch MSRP
GeForce RTX 4060	Runs slowlyDetails	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 8.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 32k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$299 launch MSRP
GeForce RTX 4060 Laptop	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 8.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 32k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	—
GeForce RTX 4060 Ti 16GB	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	$499 launch MSRP
GeForce RTX 4060 Ti 8GB	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 8.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 32k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$399 launch MSRP
GeForce RTX 4070	Runs slowlyDetails	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 12.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$599 launch MSRP
GeForce RTX 4070 Laptop	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 8.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 32k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	—
GeForce RTX 4070 Super	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 12.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$599 launch MSRP
GeForce RTX 4070 Ti Super	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	$799 launch MSRP
GeForce RTX 4080	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	$1,199 launch MSRP
GeForce RTX 4080 Laptop	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 12.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	—
GeForce RTX 4080 Super	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	$999 launch MSRP
GeForce RTX 4090 Laptop	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	—
GeForce RTX 5060	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 8.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 32k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$339 street (as of 2026-08-09)
GeForce RTX 5060 Ti 16GB	Runs slowlyDetails	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	$569 street (as of 2026-08-09)
GeForce RTX 5060 Ti 8GB	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 8.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 32k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$429 street (as of 2026-08-09)
GeForce RTX 5070	Runs slowlyDetails	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 12.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	$629 street (as of 2026-08-09)
GeForce RTX 5070 Ti	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	$949 street (as of 2026-08-09)
GeForce RTX 5070 Ti Laptop	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 12.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well	—
GeForce RTX 5080	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	$1,256 street (as of 2026-08-09)
GeForce RTX 5080 Laptop	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	—
Radeon RX 7800 XT	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	$499 launch MSRP
Radeon RX 7900 XT	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 20.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 128k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs great	$899 launch MSRP
Radeon RX 9060 XT 16GB	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	$449 street (as of 2026-08-09)
Radeon RX 9070	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	$639 street (as of 2026-08-09)
Radeon RX 9070 XT	Runs slowly	est. 19.2 tok/s13.4–24.9theoretical estimate ±30%	Q4_K_M	2.9 / 16.0 GB + 17.7 GB RAM	MoE experts in RAM	up to 64k	Experts run from system RAM — Runs well needs 20 tok/s or more on this path Try IQ4_XS: Runs well Q2_K (heavy quality loss): Runs great	$689 street (as of 2026-08-09)
DDR5-5600 dual-channel CPU · 32 GB	Runs slowly	19.0 tok/s8k estimate 13.7 tok/s (11.0–16.4, calibrated estimate ±20%)measured (1 run, 2k context)	Q4_K_M	19.4 GB RAM	CPU only	up to 64k	CPU inference — capped at Runs slowly	—
DDR5-6000 dual-channel CPU · 32 GB	Runs slowly	est. 14.7 tok/s11.7–17.6calibrated estimate ±20%	Q4_K_M	19.4 GB RAM	CPU only	up to 64k	CPU inference — capped at Runs slowly	—
DDR4-3200 dual-channel CPU · 32 GB	Runs slowly	est. 7.8 tok/s6.3–9.4calibrated estimate ±20%	Q4_K_M	19.4 GB RAM	CPU only	up to 64k	—	—

Cheapest GPUs that run it

Runs greatGeForce RTX 3090$1,050 street (as of 2026-08-09), est. 149.7 tok/s (119.8–179.7, calibrated estimate ±20%).

Measured results for Qwen3 30B-A3B (2507)

Public benchmarks we calibrate against. Their conditions (context, backend, flags) can differ from the estimates above.

Measured results for Qwen3 30B-A3B (2507)
Hardware	Quant	Backend	Context	Prompt (tok/s)	Generation (tok/s)	Flags	Source	Measured
GeForce RTX 5090	Q4_K_XL	llama.cpp	16k	—	141.6	—	hardware-corner.net	2026-08-09
GeForce RTX 4090	Q4_K_XL	llama.cpp	16k	—	139.7	—	hardware-corner.net	2026-08-09
GeForce RTX 3090	Q4_K_XL	llama.cpp	16k	—	113.8	—	hardware-corner.net	2026-08-09
DDR5-5600 dual-channel CPU	Q4_K_M	llama.cpp	2k	—	19.0	—	hardware-corner.net	2026-08-09

Frequently asked questions

How much VRAM does Qwen3 30B-A3B (2507) need?

At Q4_K_M the weights are 18.56 GB; with 8k context the total is about 19.9 GB (KV cache 0.8 GB, compute buffer 0.6 GB). The smallest tracked file (Q2_K (heavy quality loss)) needs about 12.6 GB.

What is the cheapest GPU that runs Qwen3 30B-A3B (2507) well?

Cheapest that runs it great: GeForce RTX 3090 at $1,050 (street price as of 2026-08-09), est. 149.7 tok/s (119.8–179.7, calibrated estimate ±20%).

Can Qwen3 30B-A3B (2507) run on an 8 GB, 16 GB or 24 GB GPU?

At Q4_K_M with 8k context: GeForce RTX 4060 — Runs slowly, est. 19.2 tok/s (13.4–24.9, theoretical estimate ±30%); GeForce RTX 5060 Ti 16GB — Runs slowly, est. 19.2 tok/s (13.4–24.9, theoretical estimate ±30%); GeForce RTX 3090 — Runs great, est. 149.7 tok/s (119.8–179.7, calibrated estimate ±20%).

Speeds are estimates from memory bandwidth, calibrated against public benchmarks, and each one comes with an error band and a confidence label. Real results vary with drivers, backend, context length and thermals.