Is the DGX Spark Worth $4,700?

After running benchmarks on the DGX Spark across several models in Part 1, the obvious next question is: how does it actually compare to the alternatives, and is it worth the price tag?

Here's the lineup I put together for this comparison.

1. The Contenders

The DGX is the most expensive machine on this list. The RTX 5090 has more than double the bandwidth for $900 less, which might make it the preferred choice for many hobbyists and AI practitioners. Even the Mac Studio, which a lot of people online treat as the obvious choice for running local models, has the same RAM and double the bandwidth for $1,000 less. Apple hardware being a value play is a relatively new phenomenon, but it really is competitive for local models right now.

Where the DGX Spark obviously beats everyone is form factor. It's small enough to fit in a bag, though most people probably don't need their AI lab to be portable.

2. Speed Comparison

✅ First-party data via RunPod. ⚠️ RTX 4090 and Mac Studio figures sourced from community benchmarks (r/LocalLLaMA) — RTX 4090 allocation was unavailable on RunPod during testing.

Let's get the embarrassing stat out of the way first: speed. On a 32B model, the RTX 5090 is 7.6× faster than the DGX Spark. We rented an RTX 5090 on RunPod for a few dollars to get first-party numbers. This goes back to the bandwidth advantage. When a model fits entirely in VRAM, throughput is essentially equivalent to memory bandwidth. The GDDR7 at 1,792 GB/s clearly dominates the LPDDR5x at 273 GB/s. The RTX 4090 is roughly 5× faster and the Mac Studio about 3× faster on 32B models.

The Spark is not winning on speed. There's no way to spin that differently.

3. The 128GB Advantage

What you also see in that table is that none of the alternatives can handle the 70B or 122B models at all. That's where the Spark's real advantage comes through.

The RTX 5090 smokes the Spark on 32B models. But once the model doesn't fit in VRAM anymore, the story changes completely. With partial CPU offload, models run 10–20× slower than full GPU processing. The VRAM cliff is a real problem.

The Spark handles large models without breaking a sweat. I loaded claude-distilled (16GB) and QwQ-32B (18GB) simultaneously and it handled both flawlessly. Try doing that on a 32GB GPU. R1-70B runs at 4.1 tok/s, which is slow, but usable for async tasks, research, or overnight batch jobs. My MoE model Qwen3.5:122b runs at 15.1 tok/s with ~10B active parameters per token. You simply can't load that on anything else on this list.

So yes, the 128GB of unified memory is the main selling point. Most other aspects are tradeoffs I'm willing to make.

4. The Real Competitor: Mac Studio M4 Max

In my view, the true head-to-head is the Mac Studio M4 Max. If your primary use case is inference and you're already in the Mac ecosystem, it might just be the machine to get. Same RAM, 2× the bandwidth, $1,300 cheaper.

What you get with the Spark instead is CUDA. New models, inference engines, and research repos typically run on NVIDIA before anything else. Something that appealed to me specifically was training and fine-tuning my own models. Metal is improving, but it's not on par with CUDA yet. Most cutting-edge research code runs on Linux/CUDA and requires porting to run on Metal. CUDA just gives you less friction.

5. Total Cost of Ownership

The Spark only draws about 22–45W at idle. That's generally less than a full high-end GPU desktop. Cloud at 8 hours a day breaks even with the Spark in under a year. If you're a heavy daily user, the hardware pays back fast. The question is how many hours a day you actually run inference.

On resale value, my guess is the Spark holds its value better than a GPU, but we'll see how that plays out.

6. Why I Bought It

I wanted to run models that are too large to fit on anything else. I'll admit the speed difference on 32B models was a bit of a surprise. 8.5 tok/s vs 64.8 tok/s on the RTX 5090 is a massive gap and hard to ignore. But when I load R1-70B or run two models simultaneously, I don't regret the decision. That matters more to me than raw speed.

If you need to run large models locally and CUDA matters, the Spark is the only consumer option that gets you there. If you don't, there are cheaper ways.

7. Buy or Don't Buy?