R_REDDYX.XYZ
Models2026-08-11

Ollama on Apple Silicon: how much memory is needed and which model can run on M1/M2/M3/M4

Ollama on Apple Silicon: how much memory is needed and which model can run on M1/M2/M3/M4
TL;DR: On Apple Silicon, memory is shared between CPU and GPU (unified memory) — this is not video card VRAM, and the calculation rule is different. Rough formula: a model in GGUF Q4 takes roughly as many gigabytes as it has billions of parameters, plus headroom for context and system. On 16 GB, 7-8B models live comfortably; on 8 GB — only 3B and below.

Project card — stars, tech stack, link to source — in REDDYX catalog: ollama/ollama.

WHY APPLE SILICON IS CALCULATED DIFFERENTLY THAN A VIDEO CARD

On a PC with a discrete video card, the model must fit specifically in VRAM — if it doesn't fit, some layers go to CPU and everything slows down sharply. On Mac with M-series chips, memory is unified: GPU accesses the same RAM chips as CPU, without separate video memory. Out of system 16 GB, usually 10-12 GB is realistically available for the model — part is held by macOS and background processes.

HOW MUCH MEMORY IS REALLY NEEDED: TABLE

Model (GGUF Q4_K_M)Disk SizeMinimum RAM for Comfortable WorkSuitable for Mac
Llama 3.2 3B~2 GB8 GBAny M1 and newer
Qwen2.5 7B / Llama 3.1 8B~4.5-5 GB16 GBM1/M2/M3/M4 base
Qwen2.5-Coder 14B~9 GB24-32 GBPro/Max with 32 GB+
Mixtral 8x7B (MoE)~26 GB48-64 GBMax/Ultra 64 GB
Llama 3.1 70B~40 GB64-96 GBMax/Ultra 96 GB+

Rule of thumb for estimation: for Q4 quantization, model size in gigabytes roughly equals half the number of parameters in billions (7B ≈ 4 GB, 14B ≈ 8 GB). Always add 2-4 GB on top for context window and system.

HOW TO CHECK IF YOUR MAC CAN HANDLE IT BEFORE DOWNLOADING

# find out unified memory size
sysctl hw.memsize

# run model and watch real consumption
ollama run qwen2.5:7b
# in another terminal — monitoring
sudo powermetrics --samplers gpu_power -i1000 -n5

If macOS starts actively swapping during generation (visible by slowing down of the whole system, not just the model) — the model is too large for your memory, take lower quantization (Q4 instead of Q8) or a smaller model.

QUANTIZATION: WHERE THE QUALITY BOUNDARY LIES

  • Q8 — almost no quality loss, but twice as heavy as Q4. Take if memory allows with headroom.
  • Q4_K_M — golden mean, standard choice for most tasks on Mac.
  • Q2-Q3 — noticeable quality degradation, only when memory is extremely tight.

Ollama pulls Q4_K_M by default on simple ollama pull model — explicitly specifying quantization is only needed to deviate from default: ollama pull qwen2.5:7b-instruct-q8_0.

Frequent Questions

What model can realistically run on MacBook M1 Pro 16 GB?

Comfortably — any 7-8B model in Q4 (Llama 3.1 8B, Qwen2.5 7B). 13-14B will also launch, but with less headroom for context and other apps — close heavy browser before launch.

Why does the model lag even though memory seems sufficient?

Check if part of the model went to swap — on SSD this is orders of magnitude slower than unified memory. Also long context (lots of dialog history) itself eats memory beyond model weights size.

Is there a difference between M1 and M4 in speed if the model is the same?

Yes, noticeable — newer chips have faster memory and more GPU cores, token generation per second grows noticeably from generation to generation even with same RAM amount.

We break down fresh open-source tools every day — from local LLMs to security scanners. If you want to be the first to see what actually works in 2026 — subscribe to REDDYX AI Telegram channel — new repositories every 30-60 minutes.

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram

← All articles

Ollama on Apple Silicon: how much memory is needed and which model can run on M1/M2/M3/M4 | REDDYX AI