Memory budget
macOS + apps use 3–4GB. That leaves ~4GB for the model on an 8GB Mac. Stick to 3B Q4 or 7B Q2/Q3 with short context. Close browsers before loading 7B.
M1 8GB safe picks:
llama3.2:3b → smooth chat
qwen2.5:3b → good Chinese
phi3.5:mini → fast responses
Avoid on 8GB:
llama3.1:8b @ Q4 → swap thrashing
any 14B+ modelOllama settings
Set OLLAMA_NUM_PARALLEL=1 and keep context at 2048 for 8GB machines. Monitor Memory Pressure in Activity Monitor.
export OLLAMA_NUM_PARALLEL=1
export OLLAMA_MAX_LOADED_MODELS=1
ollama pull llama3.2:3b
ollama run llama3.2:3bRelated guides
Mac M3 Max: The Ultimate Local LLM Setup
Maximise your Apple Silicon with Ollama. Run multiple models, set up an OpenAI-compatible API, and tune Metal GPU layers.
Mac M3 Pro: Realistic Model Limits
What actually fits in 18GB or 36GB unified memory with Ollama and llama.cpp.
Docker Compose LLM Stack: Ollama + Open WebUI
A production-ready Docker Compose stack that gives you a local ChatGPT experience with one command.