DeepSeek-R1-Distill-Qwen-32B
32BDeepSeek
R1 distilled to 32B. Near-frontier reasoning on a single 24GB card (Q3/Q4).
Consumer GPUPro GPU
131K
Max Context
3
Quant Variants
GGUF Q4_K_M
Best Quality
97.4%
Accuracy Retained
Quantization Variants
Per-quant VRAM, quality loss, and inference speed on RTX 4090
Measured = site benchmarks · Estimated = formula · Community = public reports
Similar models
Compare with DeepSeek-R1-Distill-Qwen-14B14B
DeepSeek-R1-Distill-Qwen-14B
DeepSeek
Consumer GPU
9.2 GBmin VRAM·98.0%accuracy
R1 reasoning distilled into 14B. Huge community interest; excellent chain-of-thought.
16B
DeepSeek-V2-Lite Chat
DeepSeek
Consumer GPUMac / Apple Silicon
9.6 GBmin VRAM·97.0%accuracy
MoE general model (~2.4B active). Long context and strong multilingual chat.
7B
DeepSeek-R1-Distill-Qwen-7B
DeepSeek
Consumer GPUMac / Apple Silicon
5.2 GBmin VRAM·97.8%accuracy
R1 reasoning in a 7B footprint. Best value for 8–12GB VRAM CoT experiments.
671B MoE
DeepSeek-V3
DeepSeek
Pro GPU
310.0 GBmin VRAM·98.0%accuracy
DeepSeek-V3 frontier MoE (~37B active / 671B total). MLA + FP8; multi-node GPU cluster required at Q4.