EN

All GPUs

AMD Instinct MI300X

AMD · CDNA 3 · 192 GB · 2023

Can this card run it?

Yes — run Qwen3.8-Flash-Next at Q2_0.

Download 70 GB · needs 48 GB system RAM.

Download the AMD · HIP / ROCm build.

Specifications

VRAM192 GB
Memory bandwidth5300 GB/s
Reading speed21032 tok/s
Writing speed574.7 tok/s
Data sourceestimated

This card is not benchmarked yet. The speeds are estimated from memory bandwidth and will be replaced when we measure it.

See the full benchmark