Datacenter€270,000
Full DeepSeek R1 in FP8
The full reasoning model, uncompressed, on a node of 8 H200s (1.1 TB of HBM memory).
Model DeepSeek R1 671BHardware 8 × H200 141 GBPrecision FP8Engine vLLMContext 32k × 4 users
Memory714 / 1,128 GB
Estimated speed~426 tok/s
Power5,600 W
Memory use63 %
vllm serve deepseek-ai/DeepSeek-R1 --tensor-parallel-size 8