What can each GPU run?
Pick your card to see every model in the index that fits it comfortably, at 4K context.
Best local LLMs by hardwareNVIDIA consumer
- RTX 509032GB · 88/110 fit comfortably
- RTX 508016GB · 63/110 fit comfortably
- RTX 5070 Ti16GB · 63/110 fit comfortably
- RTX 507012GB · 56/110 fit comfortably
- RTX 5060 Ti 16G16GB · 63/110 fit comfortably
- RTX 5060 Ti 8G8GB · 44/110 fit comfortably
- RTX 50608GB · 44/110 fit comfortably
- RTX 50508GB · 44/110 fit comfortably
- RTX 409024GB · 84/110 fit comfortably
- RTX 4080 Super16GB · 63/110 fit comfortably
- RTX 4070 Ti Super16GB · 63/110 fit comfortably
- RTX 4070 Ti12GB · 56/110 fit comfortably
- RTX 4070 Super12GB · 56/110 fit comfortably
- RTX 407012GB · 56/110 fit comfortably
- RTX 4060 Ti 16G16GB · 63/110 fit comfortably
- RTX 4060 Ti 8G8GB · 44/110 fit comfortably
- RTX 40608GB · 44/110 fit comfortably
- RTX 309024GB · 84/110 fit comfortably
- RTX 3080 Ti12GB · 56/110 fit comfortably
- RTX 3080 12G12GB · 56/110 fit comfortably
- RTX 3080 10G10GB · 56/110 fit comfortably
- RTX 3070 Ti8GB · 44/110 fit comfortably
- RTX 30708GB · 44/110 fit comfortably
- RTX 3060 12G12GB · 56/110 fit comfortably
NVIDIA DGX Spark (unified memory)
NVIDIA data centre
AMD Radeon
- Radeon RX 9070 XT16GB · 63/110 fit comfortably
- Radeon RX 907016GB · 63/110 fit comfortably
- Radeon RX 9060 XT 16G16GB · 63/110 fit comfortably
- Radeon RX 9060 XT 8G8GB · 44/110 fit comfortably
- Radeon RX 7900 XTX24GB · 84/110 fit comfortably
- Radeon RX 7900 XT20GB · 73/110 fit comfortably
- Radeon RX 7900 GRE16GB · 63/110 fit comfortably
- Radeon RX 7800 XT16GB · 63/110 fit comfortably
- Radeon RX 7700 XT12GB · 56/110 fit comfortably
- Radeon RX 7600 XT16GB · 59/110 fit comfortably
- Radeon RX 6900 XT16GB · 59/110 fit comfortably
- Radeon RX 6800 XT16GB · 59/110 fit comfortably
- Radeon RX 6700 XT12GB · 56/110 fit comfortably
- Radeon PRO W7900 48G48GB · 94/110 fit comfortably
- Radeon AI PRO R9700 32G32GB · 88/110 fit comfortably
- Instinct MI100 32G32GB · 86/110 fit comfortably
Intel Arc
Apple silicon
- Mac M5 Ultra 512G512GB · 105/110 fit comfortably
- Mac M5 Ultra 256G256GB · 101/110 fit comfortably
- Mac M5 Max 128G128GB · 100/110 fit comfortably
- Mac M5 Pro 64G64GB · 90/110 fit comfortably
- Mac M5 32G32GB · 81/110 fit comfortably
- Mac M4 Max 128G128GB · 100/110 fit comfortably
- Mac M4 Max 36G36GB · 86/110 fit comfortably
- Mac M4 Pro 48G48GB · 88/110 fit comfortably
- Mac M4 Pro 24G24GB · 65/110 fit comfortably
- Mac M3 Ultra 192G192GB · 101/110 fit comfortably
- Mac M3 Max 128G128GB · 100/110 fit comfortably
- Mac M3 Max 48G48GB · 88/110 fit comfortably
- Mac M3 Pro 36G36GB · 86/110 fit comfortably
- Mac M3 Pro 18G18GB · 57/110 fit comfortably
- Mac M3 16G16GB · 56/110 fit comfortably
- Mac M3 8G8GB · 25/110 fit comfortably
- Mac M4 24G24GB · 65/110 fit comfortably
- Mac M4 16G16GB · 56/110 fit comfortably
- Mac M2 16G16GB · 56/110 fit comfortably
- Mac M1 Max 64G64GB · 90/110 fit comfortably
- Mac M1 16G16GB · 56/110 fit comfortably
- Mac M1 8G8GB · 25/110 fit comfortably
- Mac M2 Ultra 192G192GB · 101/110 fit comfortably
- Mac M2 Max 96G96GB · 97/110 fit comfortably