Hyperscaler cost ↓ Lower is better Source: InferenceX & SemiAnalysis Market July 2026 AI Cloud TCO Model
| Model · Scenario | B200 · Reference | MI355X | B300 | GB200 NVL72 | GB300 NVL72 |
|---|---|---|---|---|---|
DeepSeek V4 Pro 1.6T8K/1K | Dynamo SGLang · FP4 | $0.539114% more expensive than B200 SGLang · FP4 | $0.36545% more expensive than B200 SGLang · FP4 | $2.668958% more expensive than B200 Dynamo vLLM · FP4 | $0.18029% cheaper than B200 Dynamo SGLang · FP4 |
DeepSeek V4 Pro 1.6TLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | SGLang · FP4 | $0.02923% cheaper than B200 MoRI SGLang · FP4 | $0.083120% more expensive than B200 SGLang · FP4 | $0.02533% cheaper than B200 Dynamo SGLang · FP4 | no exact @100 result |
Kimi K3 2.8TLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | Dynamo vLLM · FP4 | no exact @100 result | $0.1735% more expensive than B200 vLLM · FP4 | $0.26058% more expensive than B200 Dynamo vLLM · FP4 | $0.05865% cheaper than B200 Dynamo vLLM · FP4 |
Kimi K2.5/2.6/2.7-Code 1T8K/1K | vLLM · FP4 · STP | $0.2899% cheaper than B200 vLLM · FP4 · STP | $0.36916% more expensive than B200 vLLM · FP4 · STP | $0.38320% more expensive than B200 Dynamo vLLM · FP4 · STP | $0.52866% more expensive than B200 Dynamo vLLM · FP4 · STP |
MiniMax M3 428B8K/1K | vLLM · FP4 | $0.14596% more expensive than B200 vLLM · FP4 | $0.08819% more expensive than B200 vLLM · FP4 | $0.295300% more expensive than B200 Dynamo vLLM · FP8 · STP | $0.10441% more expensive than B200 Dynamo vLLM · FP8 |
MiniMax M3 428BLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | vLLM · FP4 | $0.01319% more expensive than B200 vLLM · FP4 | $0.01213% more expensive than B200 vLLM · FP4 | $0.01427% more expensive than B200 Dynamo vLLM · FP4 | $0.02087% more expensive than B200 Dynamo vLLM · FP4 |
GLM5.2Long Context Multi-Turn Realistic Agentic Scenario (AgentX) | SGLang · FP4 | $0.06854% more expensive than B200 SGLang · FP8 | $0.0417% cheaper than B200 SGLang · FP4 | $0.06345% more expensive than B200 Dynamo SGLang · FP4 | no exact @100 result |
Qwen3.5 397B8K/1K | SGLang · FP4 | $0.07534% more expensive than B200 SGLang · FP4 | $0.055About the same cost as B200 SGLang · FP4 | $0.360546% more expensive than B200 Dynamo SGLang · FP8 · STP | $0.133139% more expensive than B200 Dynamo SGLang · FP8 |
Qwen3.5 397BLong Context Multi-Turn Realistic Agentic Scenario (AgentX) | SGLang · FP4 | $0.007About the same cost as B200 SGLang · FP4 | $0.01145% more expensive than B200 SGLang · FP4 | $0.007About the same cost as B200 Dynamo SGLang · FP4 | $0.01270% more expensive than B200 Dynamo SGLang · FP4 |
8K/1K
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
8K/1K
8K/1K
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
8K/1K
Long Context Multi-Turn Realistic Agentic Scenario (AgentX)
— = no result. ∞ = B200 baseline unavailable.
If a chip does not have FP4 spec decoding available, the next best available configuration is used.
