DeepSeek V4 Pro 1.6T · Chip comparison

DeepSeek V4 Pro 1.6T — B300 vs GB200 NVL72

Head-to-head AI inference benchmark comparison of B300 (NVIDIA Blackwell) and GB200 NVL72 (NVIDIA Blackwell) on DeepSeek V4 Pro 1.6T. Latency, throughput, and cost across LLM workloads. Use the chart controls below to switch sequences, precisions, and metrics — same interactions as the main inference chart.

Near the low end of the 18–203 tok/s/user interactivity band, at 64 tok/s/user on DeepSeek V4 Pro 1.6T: B300 runs 3048 tok/s/chip at $0.21/M tokens, GB200 NVL72 runs 9108 at $0.06/M. GB200 NVL72 is 278% cheaper per token; GB200 NVL72 delivers 199% more tok/s/chip.

Setting 111 tok/s/user as the target on DeepSeek V4 Pro 1.6T, B300 produces 1513 tok/s/chip ($0.41 per million tokens) and GB200 NVL72 produces 6055 ($0.08). GB200 NVL72 is 389% cheaper per token; GB200 NVL72 delivers 300% more tok/s/chip.

At 157 tok/s/user interactivity on DeepSeek V4 Pro 1.6T, B300 delivers 870 tok/s/chip at $0.72 per million tokens; GB200 NVL72 delivers 523 tok/s/chip at $0.99. B300 is 37% cheaper per token; B300 delivers 67% more tok/s/chip at this point. (Numbers reflect the default 8k/1k · fp4 selection for this URL — table and chart below update if you change sequence, precision, or model in the controls.)

View performance-per-dollar view →

Interpolated from real benchmark data. Edit target interactivity values below to compare at different operating points.
Metric
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Throughput (tok/s/chip)
B300:3047.8GB200 NVL72:9108.2
B300:1513.0GB200 NVL72:6055.1
B300:870.4GB200 NVL72:522.7
Cost ($/M tok)
B300:$0.214GB200 NVL72:$0.057
B300:$0.415GB200 NVL72:$0.085
B300:$0.721GB200 NVL72:$0.990
tok/s/MW
B300:1604089GB200 NVL72:4870672
B300:796291GB200 NVL72:3238016
B300:458110GB200 NVL72:279500
Concurrency
B300:~60GB200 NVL72:~9943
B300:~8GB200 NVL72:~1815
B300:~3GB200 NVL72:~41

Inference Performance

Inference performance metrics across different models, hardware configurations, and serving parameters.

Vendor:
Deployment:
Spec Decoding: