Kimi K2.5/K2.6/K2.7-Code 1T · GPU comparison

Kimi K2.5/K2.6/K2.7-Code 1T — B200 vs MI355X

Head-to-head AI inference benchmark comparison of B200 (NVIDIA Blackwell) and MI355X (AMD CDNA 4) on Kimi K2.5/K2.6/K2.7-Code 1T. Latency, throughput, and cost across LLM workloads. Use the chart controls below to switch sequences, precisions, and metrics — same interactions as the main inference chart.

Near the low end of the 23–123 tok/s/user interactivity band, at 48 tok/s/user on Kimi K2.5/K2.6/K2.7-Code 1T: B200 runs 9162 tok/s/GPU at $0.06/M tokens, MI355X runs 3252 at $0.13/M. B200 is 116% cheaper per token; B200 delivers 182% more tok/s/GPU.

Setting 73 tok/s/user as the target on Kimi K2.5/K2.6/K2.7-Code 1T, B200 produces 3035 tok/s/GPU ($0.18 per million tokens) and MI355X produces 2298 ($0.18). B200 is 2% cheaper per token; B200 delivers 32% more tok/s/GPU.

At 98 tok/s/user interactivity on Kimi K2.5/K2.6/K2.7-Code 1T, B200 delivers 2013 tok/s/GPU at $0.27 per million tokens; MI355X delivers 1648 tok/s/GPU at $0.25. MI355X is 9% cheaper per token; B200 delivers 22% more tok/s/GPU at this point. (Numbers reflect the default 8k/1k · fp4 selection for this URL — table and chart below update if you change sequence, precision, or model in the controls.)

View performance-per-dollar view →

Interpolated from real benchmark data. Edit target interactivity values below to compare at different operating points.
Metric
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Interactivity (tok/s/user)
Throughput (tok/s/gpu)
B200:9161.6MI355X:3251.9
B200:3035.2MI355X:2298.5
B200:2013.2MI355X:1647.5
Cost ($/M tok)
B200:$0.059MI355X:$0.126
B200:$0.175MI355X:$0.178
B200:$0.271MI355X:$0.250
tok/s/MW
B200:5357635MI355X:1555952
B200:1774962MI355X:1099740
B200:1177336MI355X:788278
Concurrency
B200:~319MI355X:~31
B200:~156MI355X:~15
B200:~89MI355X:~8

Inference Performance

Inference performance metrics across different models, hardware configurations, and serving parameters.

Vendor:
Aggregation:
Spec Decoding: