DeepSeek V4 Pro 1.6T
8K/1K
B200
Dynamo SGLang · FP4
MI355X
cannot reach @200
B300
$1.41039% cheaper than B200
SGLang · FP4
GB200 NVL72
$5.922157% more expensive than B200
Dynamo SGLang · FP4
GB300 NVL72
$2.0969% cheaper than B200
Dynamo SGLang · FP4
Inference Cost per Million Tokens
Hyperscaler cost ↓ Lower is better Source: InferenceX & SemiAnalysis Market July 2026 AI Cloud TCO Model
| Model · Scenario | B200 · Reference | MI355X | B300 | GB200 NVL72 | GB300 NVL72 |
|---|---|---|---|---|---|
DeepSeek V4 Pro 1.6T8K/1K | Dynamo SGLang · FP4 | cannot reach @200 | $1.41039% cheaper than B200 SGLang · FP4 | $5.922157% more expensive than B200 Dynamo SGLang · FP4 | $2.0969% cheaper than B200 Dynamo SGLang · FP4 |
DeepSeek V4 Pro 1.6TLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | cannot reach @200 | cannot reach @200 | cannot reach @200 | no exact @200 result | cannot reach @200 |
Kimi K3 2.8TLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | cannot reach @200 | cannot reach @200 | cannot reach @200 | cannot reach @200 | $0.181No B200 baseline to compare against Dynamo vLLM · FP4 |
Kimi K2.5/2.6/2.7-Code 1T8K/1K | cannot reach @200 | cannot reach @200 | cannot reach @200 | cannot reach @200 | cannot reach @200 |
MiniMax M3 428B8K/1K | vLLM · FP4 | $0.402209% more expensive than B200 vLLM · FP4 | $0.16829% more expensive than B200 vLLM · FP4 | cannot reach @200 | $0.487275% more expensive than B200 Dynamo vLLM · FP8 |
MiniMax M3 428BLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | vLLM · FP4 | $0.03018% more expensive than B200 vLLM · FP4 | $0.025About the same cost as B200 vLLM · FP4 | no exact @200 result | $0.03956% more expensive than B200 Dynamo vLLM · FP4 |
GLM5.2Long Context Multi-Turn Realistic Agentic Scenario (AgentX) | SGLang · FP8 | no exact @200 result | $0.17021% more expensive than B200 SGLang · FP8 | no exact @200 result | no exact @200 result |
Qwen3.5 397B8K/1K | SGLang · FP4 | $0.14542% more expensive than B200 SGLang · FP4 | $0.106About the same cost as B200 SGLang · FP4 | $0.365257% more expensive than B200 Dynamo SGLang · FP8 | $0.595483% more expensive than B200 Dynamo SGLang · FP8 |
Qwen3.5 397BLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | SGLang · FP8 | $0.01735% cheaper than B200 SGLang · FP4 | $0.01928% cheaper than B200 SGLang · FP4 | no exact @200 result | no exact @200 result |
- View details
DeepSeek V4 Pro 1.6T
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
View detailsB200cannot reach @200MI355Xcannot reach @200B300cannot reach @200GB200 NVL72no exact @200 resultGB300 NVL72cannot reach @200Kimi K3 2.8T
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
View detailsB200cannot reach @200MI355Xcannot reach @200B300cannot reach @200GB200 NVL72cannot reach @200GB300 NVL72$0.181No B200 baseline to compare againstDynamo vLLM · FP4Kimi K2.5/2.6/2.7-Code 1T
8K/1K
View detailsB200cannot reach @200MI355Xcannot reach @200B300cannot reach @200GB200 NVL72cannot reach @200GB300 NVL72cannot reach @200MiniMax M3 428B
8K/1K
View detailsB200vLLM · FP4MI355X$0.402209% more expensive than B200vLLM · FP4B300$0.16829% more expensive than B200vLLM · FP4GB200 NVL72cannot reach @200GB300 NVL72$0.487275% more expensive than B200Dynamo vLLM · FP8MiniMax M3 428B
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
View detailsB200vLLM · FP4MI355X$0.03018% more expensive than B200vLLM · FP4B300$0.025About the same cost as B200vLLM · FP4GB200 NVL72no exact @200 resultGB300 NVL72$0.03956% more expensive than B200Dynamo vLLM · FP4GLM5.2
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
View detailsB200SGLang · FP8MI355Xno exact @200 resultB300$0.17021% more expensive than B200SGLang · FP8GB200 NVL72no exact @200 resultGB300 NVL72no exact @200 resultQwen3.5 397B
8K/1K
View detailsB200SGLang · FP4MI355X$0.14542% more expensive than B200SGLang · FP4B300$0.106About the same cost as B200SGLang · FP4GB200 NVL72$0.365257% more expensive than B200Dynamo SGLang · FP8GB300 NVL72$0.595483% more expensive than B200Dynamo SGLang · FP8Qwen3.5 397B
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
View detailsB200SGLang · FP8MI355X$0.01735% cheaper than B200SGLang · FP4B300$0.01928% cheaper than B200SGLang · FP4GB200 NVL72no exact @200 resultGB300 NVL72no exact @200 result
— = no result. ∞ = B200 baseline unavailable.
If a chip does not have FP4 spec decoding available, the next best available configuration is used.