Can Mac mini (2024) M4 Pro 64GB run Qwen3.6 35B-A3B?

Short answer

Yes. Qwen3.6 35B-A3B Q8_0 fits fully on Mac mini (2024) M4 Pro 64GB at 16k context, using 37.3 of 44.3 GB usable, and generates about ~40 tokens/s (estimated, not measured).

Measured generation speed by quantization

No measured rows for Qwen3.6 35B-A3B on Mac mini (2024) M4 Pro 64GB yet. The ~40 tok/s above is a bandwidth estimate (273 GB/s × 0.58 efficiency). Have this machine? Submit a llama-bench result and this page will switch to measured data.

Generation = tg128 (128 generated tokens, short context). Public rows are medians of community llama.cpp results (sources); our own runs use llama-bench on a rented GPU.

Alternatives

Less memory that still fits Qwen3.6 35B-A3B

Smaller memory usually means a cheaper card or Mac (we do not list prices).

• AMD RX 7900 XTX 24GB: UD-Q4_K_M, 23 GB usable, ~249 tok/s estimated
• RTX 4090 24GB: UD-Q4_K_M, 23 GB usable, ~190 tok/s measured
• RTX 3090 24GB: UD-Q4_K_M, 23 GB usable, ~159 tok/s measured

Faster for Qwen3.6 35B-A3B

• RTX 5090 32GB: UD-Q6_K, 31 GB usable, ~260 tok/s measured
• MacBook Pro 14/16 M5 Pro 48GB: UD-Q6_K, 33 GB usable, ~69 tok/s estimated
• 2x RTX 3090 (48GB total): Q8_0, 46 GB usable, ~164 tok/s estimated

Other models on Mac mini (2024) M4 Pro 64GB, similar size

• Ornith 1.5 35B-A3B (hardware page): Q8_0, fits fully, ~39 tok/s (estimated)
• Laguna XS 2.1 (hardware page): Q8_0, fits fully, ~39 tok/s (estimated)
• DeepSeek R1 Distill Qwen 32B (hardware page): Q4_K_M, fits fully, ~8 tok/s (estimated)
• Nemotron 3 Nano 30B-A3B (hardware page): Q8_0, fits fully, ~33 tok/s (estimated)

Memory and context limits

Q8_0 weights are 36.9 GB; the 16k f16 KV cache adds 0.40 GB. Largest context that fits in 44.3 GB usable:

Native limit 256k, 1.01M with YaRN. Full KV cache table for Qwen3.6 35B-A3B.

Copy-paste commands

The advisor's pick for this hardware: Q8_0, 16k context.

llama-server -hf unsloth/Qwen3.6-35B-A3B-GGUF:Q8_0 -c 16384 -fa on --jinja -ngl 99

OLLAMA_CONTEXT_LENGTH=16384 ollama serve
ollama run hf.co/unsloth/Qwen3.6-35B-A3B-GGUF:Q8_0

pip install -U mlx-vlm
mlx_vlm.generate --model mlx-community/Qwen3.6-35B-A3B-8bit --prompt "Hello" --max-tokens 256
mlx_vlm.server --model mlx-community/Qwen3.6-35B-A3B-8bit

MLX runs on Apple Silicon only. Repo: mlx-community/Qwen3.6-35B-A3B-8bit (converted with mlx-vlm, per its model card). These commands use MLX's default context handling; there is no MLX speed on this site yet.

MLX on this Mac

MLX is Apple's machine-learning framework for Apple Silicon. Where an mlx-community conversion exists, the commands above include an MLX block next to llama.cpp and ollama.

• File size. MLX's default quantization is affine with a group size of 64, and every group stores a scale and a bias (MLX docs). With 16-bit scales and biases that works out to about 4.5 bits per weight at 4-bit and 8.5 at 8-bit. llama.cpp lists Q4_K_M at about 4.89 and Q8_0 at about 8.50 bits per weight (llama.cpp quantize README). So an MLX 4-bit repo is usually a little smaller than Q4_K_M and MLX 8-bit is about the same size as Q8_0. Real repos differ because some layers (embeddings, vision towers, MoE experts in MXFP4 for gpt-oss) are stored differently, so we show each repo's actual size.
• Quality. They are different schemes. MLX 4-bit applies one bit width with per-group scale and bias, while Q4_K_M is a K-quant mix that keeps some tensors at higher precision (llama.cpp k-quants PR). We have not found a rigorous like-for-like quality comparison, so we only pair them by bit class: MLX 4-bit with Q4-class GGUF and MLX 8-bit with Q8_0.
• Speed. MLX speeds are not shown on this site yet. Published comparisons often find MLX faster than llama.cpp on Macs: an M2 Ultra study measured about 230 tok/s for MLX against about 150 for llama.cpp (short context) on Qwen-2.5 models (arXiv 2511.05502), and an M4 Max table shows mlx-lm ahead of llama.cpp on most 4-bit text models but behind on Gemma 3 4B (arXiv 2601.19139). So MLX may well run faster than the llama.cpp numbers shown here, but not for every model, and we do not estimate by how much.
• Which package. Text-only conversions run with mlx-lm. Many recent mlx-community repos (Gemma 4, Qwen3.5/3.6/3.8, Qwen3-VL) were converted with mlx-vlm and their model cards say to run them with it, so the command we show follows each repo's card.

Repos are checked against the Hugging Face API (how).

FAQ

Related

All models on Mac mini (2024) M4 Pro 64GB · Qwen3.6 35B-A3B on all hardware · VRAM tier · all measured pages · leaderboard