Best local LLMs for NVIDIA RTX Spark N1X 128GB
NVIDIA RTX Spark N1X (6144-core GPU) 128GB. Memory-fit math with KV cache, speeds labelled by how they were obtained, and commands you can paste.
Best for Coding · 16k context
| Model | Quant | Fit | Memory | Speed (generation) |
|---|---|---|---|---|
| Nemotron 3.5 Super VL 120B-A12B | Q4_K_M | fits fully | 70.4 GB | ~28 tok/s estimated |
| gpt-oss 120B | Q8_0 | fits fully | 64.0 GB | ~68 tok/s estimated |
| Qwen3-Coder 30B-A3B | Q8_0 | fits fully | 34.1 GB | ~54 tok/s estimated |
| Laguna XS 2.1 | Q8_0 | fits fully | 36.3 GB | ~59 tok/s estimated |
| Nemotron 3 Nano 30B-A3B | Q8_0 | fits fully | 33.7 GB | ~51 tok/s estimated |
llama-server -hf lmstudio-community/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF:Q4_K_M -c 16384 -fa on --jinja -ngl 99
OLLAMA_CONTEXT_LENGTH=16384 ollama serve ollama run hf.co/lmstudio-community/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF:Q4_K_M
Context length is an Ollama server setting: quit the Ollama app or stop the service first, or set it in its environment (launchctl on Mac, systemctl on Linux).
Best for Chat / general · 16k context
| Model | Quant | Fit | Memory | Speed (generation) |
|---|---|---|---|---|
| Nemotron 3.5 Super VL 120B-A12B | Q4_K_M | fits fully | 70.4 GB | ~28 tok/s estimated |
| gpt-oss 120B | Q8_0 | fits fully | 64.0 GB | ~68 tok/s estimated |
| Gemma 4 12B | Q8_0 | fits fully | 13.3 GB | ~19 tok/s estimated |
| Nemotron 3 Nano 30B-A3B | Q8_0 | fits fully | 33.7 GB | ~51 tok/s estimated |
| Qwen3.6 35B-A3B | Q8_0 | fits fully | 37.3 GB | ~61 tok/s estimated |
llama-server -hf lmstudio-community/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF:Q4_K_M -c 16384 -fa on --jinja -ngl 99
OLLAMA_CONTEXT_LENGTH=16384 ollama serve ollama run hf.co/lmstudio-community/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF:Q4_K_M
Context length is an Ollama server setting: quit the Ollama app or stop the service first, or set it in its environment (launchctl on Mac, systemctl on Linux).
Best for Vision · 16k context
| Model | Quant | Fit | Memory | Speed (generation) |
|---|---|---|---|---|
| Nemotron 3.5 Super VL 120B-A12B | Q4_K_M | fits fully | 70.4 GB | ~28 tok/s estimated |
| Gemma 4 12B | Q8_0 | fits fully | 13.3 GB | ~19 tok/s estimated |
| Qwen3.6 35B-A3B | Q8_0 | fits fully | 37.3 GB | ~61 tok/s estimated |
| Gemma 4 26B-A4B | Q8_0 | fits fully | 27.4 GB | ~48 tok/s estimated |
| Qwen3.5 9B | Q8_0 | fits fully | 10.1 GB | ~25 tok/s estimated |
llama-server -hf lmstudio-community/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF:Q4_K_M -c 16384 -fa on --jinja -ngl 99
OLLAMA_CONTEXT_LENGTH=16384 ollama serve ollama run hf.co/lmstudio-community/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF:Q4_K_M
Context length is an Ollama server setting: quit the Ollama app or stop the service first, or set it in its environment (launchctl on Mac, systemctl on Linux).
All 29 models that fit, fastest first · 16k context
Click a column header to sort. 0 of 29 speeds here are measured or scaled from measured; the rest are bandwidth estimates. Filter by use case, speed source, fit, license and more in the interactive advisor →
| Model | Params | Quant | Fit | Memory | Tok/s | Source |
|---|---|---|---|---|---|---|
| gpt-oss 20B | 20.91B MoE | Q8_0 | fits fully | 12.5 GB | ~91 | estimated |
| LFM2.5 24B-A2B | 23.97B MoE | Q8_0 | fits fully | 25.8 GB | ~72 | estimated |
| Flint 40B-A2.5B | 39.79B MoE | Q8_0 | fits fully | 42.8 GB | ~71 | estimated |
| gpt-oss 120B | 116.83B MoE | Q8_0 | fits fully | 64.0 GB | ~68 | estimated |
| GLM-4.7-Flash | 31.22B MoE | Q8_0 | fits fully | 32.7 GB | ~62 | estimated |
| Qwen3.6 35B-A3B | 35.95B MoE | Q8_0 | fits fully | 37.3 GB | ~61 | estimated |
| Ornith 1.5 35B-A3B | 35.95B MoE | Q8_0 | fits fully | 38.2 GB | ~60 | estimated |
| Laguna XS 2.1 | 33.44B MoE | Q8_0 | fits fully | 36.3 GB | ~59 | estimated |
| Nemotron 3.5 Lightning 30B-A3B | 31.58B MoE | Q8_0 | fits fully | 35.2 GB | ~57 | estimated |
| Nemotron 3 Nano 4B | 3.97B | Q8_0 | fits fully | 4.6 GB | ~57 | estimated |
| Qwen3-Coder 30B-A3B | 30.53B MoE | Q8_0 | fits fully | 34.1 GB | ~54 | estimated |
| Qwen3.5 4B | 4.66B | Q8_0 | fits fully | 5.1 GB | ~53 | estimated |
| Nemotron 3 Nano 30B-A3B | 31.58B MoE | Q8_0 | fits fully | 33.7 GB | ~51 | estimated |
| Gemma 4 26B-A4B | 25.81B MoE | Q8_0 | fits fully | 27.4 GB | ~48 | estimated |
| DeepSeek R1 Distill Qwen 7B | 7.62B | Q8_0 | fits fully | 9.0 GB | ~30 | estimated |
| Gemma 4 E4B | 8B | Q8_0 | fits fully | 8.5 GB | ~29 | estimated |
| Nemotron 3.5 Super VL 120B-A12B | 124.45B MoE | Q4_K_M | fits fully | 70.4 GB | ~28 | estimated |
| Qwen3-VL 8B | 8.77B | Q8_0 | fits fully | 11.1 GB | ~27 | estimated |
| Qwen3.5 9B | 9.65B | Q8_0 | fits fully | 10.1 GB | ~25 | estimated |
| Ornith 1.5 9B | 9.65B | Q8_0 | fits fully | 10.1 GB | ~25 | estimated |
| Gemma 4 12B | 11.96B | Q8_0 | fits fully | 13.3 GB | ~19 | estimated |
| GLM-4.5-Air | 110.47B MoE | Q6_K | fits fully | 102.1 GB | ~18 | estimated |
| Mistral Small 3.2 24B | 24.01B | Q4_K_M | fits fully | 17.0 GB | ~17 | estimated |
| Qwen3.8 27B | 27.78B | UD-Q4_K_M | fits fully | 17.7 GB | ~15 | estimated |
| Qwen3.6 27B | 27.78B | Q4_K_M | fits fully | 18.1 GB | ~14 | estimated |
| Gemma 4 31B | 31.27B | Q4_K_M | fits fully | 20.5 GB | ~13 | estimated |
| DeepSeek R1 Distill Qwen 32B | 32.76B | Q4_K_M | fits fully | 24.1 GB | ~12 | estimated |
| Nanbeige4.3 33B | 33.12B | Q4_K_M | fits fully | 24.3 GB | ~12 | estimated |
| Llama 3.3 70B | 70.55B | Q4_K_M | fits fully | 47.9 GB | ~6 | estimated |
Long context on this hardware · up to 1M tokens
Largest context whose KV cache still fits next to the weights (same placement as the 16k result, KV types f16 / q8_0 / q4_0). Models are capped at their verified maximum; extended means beyond the native maximum using YaRN, only listed where the model card documents it. Long context needs flash attention (-fa on, already in the commands) and a lot of memory; a quantized KV cache saves memory but can cost accuracy. Speed at depth is an estimate (penalty fitted to measured depth runs up to 128k).
Try it in the advisor: 128k · 256k · 512k · 1M
| Model | Native max | Max ctx f16 | Max ctx q8_0 | Max ctx q4_0 | Est. tok/s at max f16 ctx |
|---|---|---|---|---|---|
| Qwen3.6 35B-A3B Q8_0 | 256k | 1M extended | 1M extended | 1M extended | ~10 estimated |
| Qwen3.5 4B Q8_0 | 256k | 1M extended | 1M extended | 1M extended | ~8 estimated |
| Nemotron 3.5 Super VL 120B-A12B Q4_K_M | 1M | 1M | 1M | 1M | ~15 estimated |
| Qwen3.5 9B Q8_0 | 256k | 1M extended | 1M extended | 1M extended | ~7 estimated |
| Qwen3.8 27B UD-Q4_K_M | 256k | 1M extended | 1M extended | 1M extended | ~4 estimated |
| Qwen3.6 27B Q4_K_M | 256k | 1M extended | 1M extended | 1M extended | ~4 estimated |
| Qwen3-Coder 30B-A3B Q8_0 | 256k | 512k extended | 1M extended | 1M extended | ~5 estimated |
| Qwen3-VL 8B Q8_0 | 256k | 512k extended | 1M extended | 1M extended | ~4 estimated |
| Flint 40B-A2.5B Q8_0 | 256k | 256k | 256k | 256k | ~23 estimated |
| Ornith 1.5 35B-A3B Q8_0 | 256k | 256k | 256k | 256k | ~26 estimated |
| Laguna XS 2.1 Q8_0 | 256k | 256k | 256k | 256k | ~17 estimated |
| Nemotron 3.5 Lightning 30B-A3B Q8_0 | 256k | 256k | 256k | 256k | ~42 estimated |
| Nemotron 3 Nano 4B Q8_0 | 256k | 256k | 256k | 256k | ~32 estimated |
| Nemotron 3 Nano 30B-A3B Q8_0 | 256k | 256k | 256k | 256k | ~38 estimated |
| Gemma 4 26B-A4B Q8_0 | 256k | 256k | 256k | 256k | ~23 estimated |
| Ornith 1.5 9B Q8_0 | 256k | 256k | 256k | 256k | ~15 estimated |
| Gemma 4 12B Q8_0 | 256k | 256k | 256k | 256k | ~15 estimated |
| Gemma 4 31B Q4_K_M | 256k | 256k | 256k | 256k | ~7 estimated |
| Nanbeige4.3 33B Q4_K_M | 512k | 256k | 512k | 512k | ~4 estimated |
| gpt-oss 20B Q8_0 | 128k | 128k | 128k | 128k | ~42 estimated |
| LFM2.5 24B-A2B Q8_0 | 128k | 128k | 128k | 128k | ~41 estimated |
| gpt-oss 120B Q8_0 | 128k | 128k | 128k | 128k | ~30 estimated |
| GLM-4.7-Flash Q8_0 | 198k | 128k | 128k | 128k | ~23 estimated |
| DeepSeek R1 Distill Qwen 7B Q8_0 | 128k | 128k | 128k | 128k | ~18 estimated |
| Gemma 4 E4B Q8_0 | 128k | 128k | 128k | 128k | ~24 estimated |
| Mistral Small 3.2 24B Q4_K_M | 128k | 128k | 128k | 128k | ~8 estimated |
| DeepSeek R1 Distill Qwen 32B Q4_K_M | 128k | 128k | 128k | 128k | ~5 estimated |
| Llama 3.3 70B Q4_K_M | 128k | 128k | 128k | 128k | ~3 estimated |
| GLM-4.5-Air Q6_K | 128k | 32k | 64k | 128k | ~12 estimated |
FAQ
What is the best local LLM for NVIDIA RTX Spark N1X 128GB?
Of the 29 models that fit fully at 16k context, gpt-oss 20B Q8_0 is the fastest at ~91 tok/s (estimated); the largest is Nemotron 3.5 Super VL 120B-A12B Q4_K_M.
How much memory can NVIDIA RTX Spark N1X 128GB use for a model?
About 108.3 GB usable for the model and KV cache, with 300 GB/s memory bandwidth.
Can NVIDIA RTX Spark N1X 128GB run long contexts?
See the long-context table above: it lists the largest context whose KV cache fits next to the weights for every model, up to 1M tokens where the model supports it.
Open the interactive advisor with this hardware →
Speeds marked measured are medians of real runs (short-context generation) from these sources; scaled from measured means a measurement of a same-size or same-model-different-quant run, scaled by bytes read; estimated comes from memory bandwidth (spec source: https://docs.nvidia.com/rtx-spark/rtx-spark-porting-guide/latest/overview.html) × an efficiency factor of 0.80 calibrated to measured runs on this hardware class. No measured data on file for this hardware yet · submit your benchmark. Memory size on this page is an example configuration; check what your machine has. Model data last verified 2026-10-26. Ranking = fits and fast enough first, then larger; not a quality benchmark.
Page generated 2026-10-26 by tools/generate_pages.js