DeepSeek V4 Pro 1.6T
8K/1K
B200
vLLM · FP4
MI355X
$0.10453% cheaper than B200
ATOM¹ · FP4
B300
$0.18217% cheaper than B200
vLLM · FP4
GB200 NVL72
$0.225About the same cost as B200
Dynamo vLLM · FP4
GB300 NVL72
no exact @30 result
Inference Cost per Million Tokens
Hyperscaler cost ↓ Lower is better Source: InferenceX & SemiAnalysis Market July 2026 AI Cloud TCO Model
| Model · Scenario | B200 · Reference | MI355X | B300 | GB200 NVL72 | GB300 NVL72 |
|---|---|---|---|---|---|
DeepSeek V4 Pro 1.6T8K/1K | vLLM · FP4 | $0.10453% cheaper than B200 ATOM¹ · FP4 | $0.18217% cheaper than B200 vLLM · FP4 | $0.225About the same cost as B200 Dynamo vLLM · FP4 | no exact @30 result |
DeepSeek V4 Pro 1.6TLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | no exact @30 result | $0.010No B200 baseline to compare against SGLang · FP4 | $0.007No B200 baseline to compare against vLLM · FP4 | no exact @30 result | no exact @30 result |
Kimi K3 2.8TLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | Dynamo vLLM · FP4 | $0.03826% cheaper than B200 ATOM¹ · FP4 | $0.08055% more expensive than B200 vLLM · FP4 | $0.07648% more expensive than B200 Dynamo vLLM · FP4 | $0.03434% cheaper than B200 Dynamo vLLM · FP4 |
Kimi K2.5/2.6/2.7-Code 1T8K/1K | vLLM · FP4 · STP | $0.0947% cheaper than B200 ATOM¹ · FP4 · STP | $0.12422% more expensive than B200 vLLM · FP4 · STP | no exact @30 result | no exact @30 result |
MiniMax M3 428B8K/1K | vLLM · FP8 | $0.04719% cheaper than B200 ATOM¹ · FP4 | $0.04620% cheaper than B200 vLLM · FP4 | $0.08649% more expensive than B200 Dynamo vLLM · FP8 · STP | no exact @30 result |
MiniMax M3 428BLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | no exact @30 result | no exact @30 result | no exact @30 result | no exact @30 result | no exact @30 result |
GLM5.2Long Context Multi-Turn Realistic Agentic Scenario (AgentX) | no exact @30 result | $0.013No B200 baseline to compare against ATOM¹ · FP4 | no exact @30 result | no exact @30 result | no exact @30 result |
Qwen3.5 397B8K/1K | TRTLLM · FP4 | $0.04225% more expensive than B200 SGLang · FP4 | $0.069107% more expensive than B200 SGLang · FP8 | no exact @30 result | no exact @30 result |
Qwen3.5 397BLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | no exact @30 result | $0.007No B200 baseline to compare against SGLang · FP8 | no exact @30 result | no exact @30 result | no exact @30 result |
- View details
DeepSeek V4 Pro 1.6T
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
View detailsB200no exact @30 resultMI355X$0.010No B200 baseline to compare againstSGLang · FP4B300$0.007No B200 baseline to compare againstvLLM · FP4GB200 NVL72no exact @30 resultGB300 NVL72no exact @30 resultKimi K3 2.8T
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
View detailsB200Dynamo vLLM · FP4MI355X$0.03826% cheaper than B200ATOM¹ · FP4B300$0.08055% more expensive than B200vLLM · FP4GB200 NVL72$0.07648% more expensive than B200Dynamo vLLM · FP4GB300 NVL72$0.03434% cheaper than B200Dynamo vLLM · FP4Kimi K2.5/2.6/2.7-Code 1T
8K/1K
View detailsB200vLLM · FP4STPMI355X$0.0947% cheaper than B200ATOM¹ · FP4STPB300$0.12422% more expensive than B200vLLM · FP4STPGB200 NVL72no exact @30 resultGB300 NVL72no exact @30 resultMiniMax M3 428B
8K/1K
View detailsB200vLLM · FP8MI355X$0.04719% cheaper than B200ATOM¹ · FP4B300$0.04620% cheaper than B200vLLM · FP4GB200 NVL72$0.08649% more expensive than B200Dynamo vLLM · FP8STPGB300 NVL72no exact @30 resultMiniMax M3 428B
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
View detailsB200no exact @30 resultMI355Xno exact @30 resultB300no exact @30 resultGB200 NVL72no exact @30 resultGB300 NVL72no exact @30 resultGLM5.2
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
View detailsB200no exact @30 resultMI355X$0.013No B200 baseline to compare againstATOM¹ · FP4B300no exact @30 resultGB200 NVL72no exact @30 resultGB300 NVL72no exact @30 resultQwen3.5 397B
8K/1K
View detailsB200TRTLLM · FP4MI355X$0.04225% more expensive than B200SGLang · FP4B300$0.069107% more expensive than B200SGLang · FP8GB200 NVL72no exact @30 resultGB300 NVL72no exact @30 resultQwen3.5 397B
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
View detailsB200no exact @30 resultMI355X$0.007No B200 baseline to compare againstSGLang · FP8B300no exact @30 resultGB200 NVL72no exact @30 resultGB300 NVL72no exact @30 result
— = no result. ∞ = B200 baseline unavailable.
If a chip does not have FP4 spec decoding available, the next best available configuration is used.