EN

A30X

NVIDIA · Server Ampere · 24 GB · 2021

Can this card run it?

Yes — run Qwen3.8-Flash-Next at Q2_0.

Download 70 GB · needs 48 GB system RAM.

Download the NVIDIA · CUDA 12 (legacy) build.

Specifications

VRAM24 GB
Memory bandwidth1.22 GB/s
Reading speed5 tok/s
Writing speed0.1 tok/s
Board power230 W
Data sourceestimated

This card is not benchmarked yet. The speeds are estimated from memory bandwidth and will be replaced when we measure it.

See the full benchmark table

Compare with similar cards

More in this series