DeepSeek V4 Pro 1.6T · Chip comparison

DeepSeek V4 Pro 1.6T — B200 vs GB200 NVL72

Head-to-head AI inference benchmark comparison of B200 (NVIDIA Blackwell) and GB200 NVL72 (NVIDIA Blackwell) on DeepSeek V4 Pro 1.6T. Latency, throughput, and cost across LLM workloads. Use the chart controls below to switch sequences, precisions, and metrics — same interactions as the main inference chart.

B200 posts 6822 tok/s/chip for $0.07 per million tokens at 64 tok/s/user on DeepSeek V4 Pro 1.6T; GB200 NVL72 posts 9108 tok/s/chip for $0.06. GB200 NVL72 is 24% cheaper per token; GB200 NVL72 delivers 34% more tok/s/chip.

Throughput at 111 tok/s/user on DeepSeek V4 Pro 1.6T: B200 hits 1847 tok/s/chip, GB200 NVL72 hits 6055. Per-million costs land at $0.26 and $0.08 respectively. GB200 NVL72 is 204% cheaper per token; GB200 NVL72 delivers 228% more tok/s/chip.

B200 / GB200 NVL72 on DeepSeek V4 Pro 1.6T at 157 tok/s/user: 618 / 523 tok/s/chip, $0.78 / $0.99 per million tokens. B200 is 27% cheaper per token; B200 delivers 18% more tok/s/chip. (Numbers reflect the default 8k/1k · fp4 selection for this URL — table and chart below update if you change sequence, precision, or model in the controls.)

View performance-per-dollar view →

Interpolated from real benchmark data. Edit target interactivity values below to compare at different operating points.
Metric
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Throughput (tok/s/chip)
B200:6822.5GB200 NVL72:9108.2
B200:1846.6GB200 NVL72:6055.1
B200:617.9GB200 NVL72:522.7
Cost ($/M tok)
B200:$0.070GB200 NVL72:$0.057
B200:$0.258GB200 NVL72:$0.085
B200:$0.778GB200 NVL72:$0.990
tok/s/MW
B200:3989742GB200 NVL72:4870672
B200:1079875GB200 NVL72:3238016
B200:361338GB200 NVL72:279500
Concurrency
B200:~560GB200 NVL72:~9943
B200:~166GB200 NVL72:~1815
B200:~7GB200 NVL72:~41

Inference Performance

Inference performance metrics across different models, hardware configurations, and serving parameters.

Vendor:
Deployment:
Spec Decoding: