18GB M3 Pro
Stick to 7–8B models at Q4. Avoid 14B+ unless you accept very short context.
text
✓ Llama 3.1 8B Q4_K_M (ctx 8K)
✓ Qwen2.5 7B Q4_K_M
✗ Qwen2.5 14B Q4_K_M (needs 36GB+)36GB M3 Pro
14B models at Q4_K_M with 8K context work well. 32B requires Q3 or heavy context sacrifice.
bash
ollama pull qwen2.5:14b
ollama run qwen2.5:14bRelated guides
BeginnerMac / Apple6 min read
Mac M3 Max: The Ultimate Local LLM Setup
Maximise your Apple Silicon with Ollama. Run multiple models, set up an OpenAI-compatible API, and tune Metal GPU layers.
BeginnerMac / Apple7 min read
M1 / M2 Mac 8GB: Realistic Ollama Limits
Unified memory is shared with macOS — here is what actually works on base MacBooks without swapping.
BeginnerDocker5 min read
Docker Compose LLM Stack: Ollama + Open WebUI
A production-ready Docker Compose stack that gives you a local ChatGPT experience with one command.
Deployment guides are educational. Each model is subject to its own license — read the official Hugging Face model card before downloading or deploying.