EN

PG506-232

NVIDIA · Server Ampere · 24 GB · 2021

Can this card run it?

Yes — run Qwen3.8-Flash-Next at Q2_0.

Download 70 GB · needs 48 GB system RAM.

Download the NVIDIA · CUDA 12 (legacy) build.

Specifications

VRAM24 GB
Memory bandwidth933.1 GB/s
Reading speed3703 tok/s
Writing speed101.2 tok/s
Board power165 W
Data sourceestimated

This card is not benchmarked yet. The speeds are estimated from memory bandwidth and will be replaced when we measure it.

See the full benchmark table

Compare with similar cards

More in this series