Best Local LLMs for 8–32 GB GPUs

Compare up to three catalog picks per GPU memory tier for chat, coding and multimodal tasks, with quantization levels and estimated memory at 4K context.

Memory estimates at 4,096 tokens for one text sequence.

For each task, these NVIDIA tiers favor a larger model that leaves memory headroom. A model selected for two tasks appears once. Estimates assume one text sequence. Image inputs also need encoder memory.

8 GB

12 GB

16 GB

24 GB

32 GB