Devstral Small 1.1 24B

24B

Mistral Devstral

Mistral + All Hands agentic coding model on a Mistral Small 3.1 base. Built for repo-scale tool use rather than single-file completion. Q4 ~14GB fits a 16GB card.

⬇ 109.7K HF downloads♥ 368 likesmistralai/Devstral-Small-2507· stats from 8/8/2026

Consumer GPUMac / Apple Silicon

131K

Max Context

Quant Variants

GGUF Q6_K

Best Quality

99.4%

Accuracy Retained

Calculate VRAM Hugging Face Compare

Quantization Variants

Per-quant VRAM, quality loss, and inference speed on RTX 4090

Measured = site benchmarks · Estimated = formula · Community = public reports

Format	Level	BPW	VRAM	PPL Loss	Speed	Source	Actions
GGUF	Q4_K_M	4.85	14.3 GB	2.9%	62 tok/s	Community	Calc HF
GGUF	Q5_K_M	5.68	16.8 GB	1.4%	55 tok/s	Estimated	Calc HF
GGUF	Q6_K	6.56	19.4 GB	0.6%	48 tok/s	Estimated	Calc HF
AWQ	INT4	4	13.0 GB	4.0%	78 tok/s	Estimated	Calc HF
EXL2	4.65bpw	4.65	13.9 GB	2.5%	88 tok/s	Estimated	Calc HF

Similar models

Compare with Qwen3 30B-A3B

30B-A3B

Qwen3 30B-A3B Instruct

Alibaba Qwen3

Consumer GPUMac / Apple Silicon

17.5 GBmin VRAM·98.9%accuracy

Qwen3 MoE with only 3B active params. Q4 ~19GB file; outperforms QwQ-32B on 16GB cards.

30B-A3B

Qwen3-Coder 30B-A3B Instruct

Alibaba Qwen3

Consumer GPUMac / Apple Silicon

17.8 GBmin VRAM·99.0%accuracy

Agentic coding MoE with 3.3B active params and 256K native context. Top open coder for 16–24GB cards.

21B MoE

GPT-OSS 20B

OpenAI GPT-OSS

Consumer GPUMac / Apple Silicon

11.9 GBmin VRAM·100.0%accuracy

OpenAI open-weight MoE (21B total / 3.6B active), shipped natively in MXFP4 — ~12.8GB runs on a 16GB card with no quality tax. Only 3.6B active params means CPU-offload stays usable.

32B

Qwen2.5 32B Instruct

Alibaba Qwen2.5

Consumer GPUPro GPU

16.4 GBmin VRAM·97.3%accuracy

Near-GPT-4 reasoning on a 24GB VRAM card (Q4_K_S). Groundbreaking value.