Llama 3.3 70B — B200 vs MI300X
Head-to-head AI inference benchmark comparison of B200 (NVIDIA Blackwell) and MI300X (AMD CDNA 3) on Llama 3.3 70B. Latency, throughput, and cost across LLM workloads. Use the chart controls below to switch sequences, precisions, and metrics — same interactions as the main inference chart.
Near the low end of the 34–112 tok/s/user interactivity band, at 53 tok/s/user on Llama 3.3 70B: B200 runs 6496 tok/s/chip at $0.07/M tokens, MI300X runs 1185 at $0.22/M. B200 is 194% cheaper per token; B200 delivers 448% more tok/s/chip.
Setting 73 tok/s/user as the target on Llama 3.3 70B, B200 produces 4657 tok/s/chip ($0.10 per million tokens) and MI300X produces 660 ($0.41). B200 is 294% cheaper per token; B200 delivers 606% more tok/s/chip.
At 93 tok/s/user interactivity on Llama 3.3 70B, B200 delivers 3478 tok/s/chip at $0.14 per million tokens; MI300X delivers 373 tok/s/chip at $0.71. B200 is 420% cheaper per token; B200 delivers 832% more tok/s/chip at this point. (Numbers reflect the default 1k/1k · fp8 selection for this URL — table and chart below update if you change sequence, precision, or model in the controls.)
| Metric | Interactivity (tok/s/user) | Interactivity (tok/s/user) | Interactivity (tok/s/user) |
|---|---|---|---|
| Throughput (tok/s/chip) | B200:6496.2MI300X:1185.2 | B200:4657.0MI300X:660.0 | B200:3477.7MI300X:372.9 |
| Cost ($/M tok) | B200:$0.074MI300X:$0.218 | B200:$0.103MI300X:$0.407 | B200:$0.136MI300X:$0.706 |
| tok/s/MW | B200:3798954MI300X:852686 | B200:2723369MI300X:474795 | B200:2033744MI300X:268306 |
| Concurrency | B200:~128MI300X:~50 | B200:~128MI300X:~32 | B200:~86MI300X:~17 |
Inference Performance
Inference performance metrics across different models, hardware configurations, and serving parameters.