Unified memory · LPDDR5X unified memory
NVIDIA DGX Spark 128 GB: which LLMs can it run?
Of 128 GB of unified memory, about 109 GB are usable by the GPU. On its own, it loads up to Mistral Large 123B in Q4. It is a complete machine: you cannot add cards to it.
Specifications
Memory128 GB
Bandwidth273 GB/s
FP16 compute~100 TF
Power240 W
Indicative price€4,000
€ per usable GB€37
Against cards at the same price
Recipes with this hardware
Models and expected speed
| Model | Q4 | Q8 | FP16 |
|---|---|---|---|
| Qwen3 4B | ✓ ~59 tok/s | ✓ ~34 tok/s | ✓ ~18 tok/s |
| Llama 3.1 8B | ✓ ~30 tok/s | ✓ ~17 tok/s | ✓ ~9.3 tok/s |
| Qwen3 8B | ✓ ~30 tok/s | ✓ ~17 tok/s | ✓ ~9.1 tok/s |
| Gemma 3 12B | ✓ ~20 tok/s | ✓ ~12 tok/s | ✓ ~6.2 tok/s |
| Mistral Nemo 12B | ✓ ~20 tok/s | ✓ ~11 tok/s | ✓ ~6.1 tok/s |
| Phi-4 14B | ✓ ~17 tok/s | ✓ ~9.5 tok/s | ✓ ~5.1 tok/s |
| Qwen3 14B | ✓ ~17 tok/s | ✓ ~9.5 tok/s | ✓ ~5.0 tok/s |
| gpt-oss-20b | ✓ ~65 tok/s | ✓ ~38 tok/s | ✓ ~20 tok/s |
| Mistral Small 24B | ✓ ~10 tok/s | ✓ ~5.9 tok/s | ✓ ~3.1 tok/s |
| Gemma 3 27B | ✓ ~9.2 tok/s | ✓ ~5.2 tok/s | ✓ ~2.8 tok/s |
| Qwen3.8 27B | ✓ ~8.9 tok/s | ✓ ~5.0 tok/s | ✓ ~2.7 tok/s |
| Qwen3 30B-A3B | ✓ ~70 tok/s | ✓ ~41 tok/s | ✓ ~22 tok/s |
| Qwen3 32B | ✓ ~7.6 tok/s | ✓ ~4.3 tok/s | ✓ ~2.3 tok/s |
| Qwen2.5 Coder 32B | ✓ ~7.6 tok/s | ✓ ~4.3 tok/s | ✓ ~2.3 tok/s |
| DeepSeek R1 Distill 32B | ✓ ~7.6 tok/s | ✓ ~4.3 tok/s | ✓ ~2.3 tok/s |
| Mixtral 8x7B | ✓ ~19 tok/s | ✓ ~11 tok/s | ✓ ~5.8 tok/s |
| Llama 3.3 70B | ✓ ~3.5 tok/s | ✓ ~2.0 tok/s | ✗ |
| GLM-4.5-Air 106B | ✓ ~20 tok/s | ✗ | ✗ |
| gpt-oss-120b | ✓ ~47 tok/s | ✗ | ✗ |
| Mistral Large 123B | ✓ ~2.0 tok/s | ✗ | ✗ |
| Qwen3 235B-A22B | ✗ | ✗ | ✗ |
| GLM-4.5 355B | ✗ | ✗ | ✗ |
| Llama 3.1 405B | ✗ | ✗ | ✗ |
| DeepSeek R1 671B | ✗ | ✗ | ✗ |
| DeepSeek V3.1 671B | ✗ | ✗ | ✗ |
| Kimi K2 1T | ✗ | ✗ | ✗ |
8k tokens, one user. “2 ×” = number of cards needed, speed with tensor parallelism (vLLM). ✗ = doesn’t fit, even with 1 cards.