GLM 5.2 · MI355X · Precision Comparison

MI355X: FP4 vs FP8 Precision Comparison

How FP4 and FP8 precision affect GLM 5.2 inference on MI355X (AMD CDNA 4). Throughput, latency, and cost across LLM workloads. Use the chart controls below to switch sequences and metrics — same interactions as the main inference chart.

All precision comparisons →Open the full dashboard →

GLM 5.2: FP4 versus FP8 throughput and cost at matched interactivity levels on MI355X — FP4 versus FP8 throughput and cost per million tokens on MI355X for this comparison's canonical default workload.

No interpolated comparison data available for this precision pair. Use the chart controls below to select a different sequence with benchmark data for both precisions.

Inference Performance

Inference performance metrics across different models, hardware configurations, and serving parameters.

Model

Scenario

Precision

Y-Axis Metric

Chip Config

Quick Filters

Vendor:

Deployment:

Spec Decoding: