Kimi K2.5/K2.6/K2.7-Code 1T — B200 vs MI355X
Head-to-head AI inference benchmark comparison of B200 (NVIDIA Blackwell) and MI355X (AMD CDNA 4) on Kimi K2.5/K2.6/K2.7-Code 1T. Latency, throughput, and cost across LLM workloads. Use the chart controls below to switch sequences, precisions, and metrics — same interactions as the main inference chart.
Near the low end of the 11–123 tok/s/user interactivity band, at 38 tok/s/user on Kimi K2.5/K2.6/K2.7-Code 1T: B200 runs 12043 tok/s/chip at $0.04/M tokens, MI355X runs 4004 at $0.10/M. B200 is 161% cheaper per token; B200 delivers 201% more tok/s/chip.
Setting 67 tok/s/user as the target on Kimi K2.5/K2.6/K2.7-Code 1T, B200 produces 3662 tok/s/chip ($0.13 per million tokens) and MI355X produces 2493 ($0.17). B200 is 27% cheaper per token; B200 delivers 47% more tok/s/chip.
At 95 tok/s/user interactivity on Kimi K2.5/K2.6/K2.7-Code 1T, B200 delivers 1643 tok/s/chip at $0.29 per million tokens; MI355X delivers 1739 tok/s/chip at $0.24. MI355X is 23% cheaper per token; MI355X delivers 6% more tok/s/chip at this point. (Numbers reflect the default 8k/1k · fp4 selection for this URL — table and chart below update if you change sequence, precision, or model in the controls.)
| Metric | Interactivity (tok/s/user) | Interactivity (tok/s/user) | Interactivity (tok/s/user) |
|---|---|---|---|
| Throughput (tok/s/chip) | B200:12042.6MI355X:4003.6 | B200:3662.1MI355X:2492.7 | B200:1643.4MI355X:1738.7 |
| Cost ($/M tok) | B200:$0.040MI355X:$0.105 | B200:$0.132MI355X:$0.167 | B200:$0.292MI355X:$0.238 |
| tok/s/MW | B200:7042449MI355X:1915595 | B200:2141577MI355X:1192676 | B200:961048MI355X:831906 |
| Concurrency | B200:~736MI355X:~102 | B200:~178MI355X:~17 | B200:~9MI355X:~9 |
Inference Performance
Inference performance metrics across different models, hardware configurations, and serving parameters.