RTX A4000H
NVIDIA · Workstation Ampere · 16 GB · 2021
Can this card run it?
Yes — run Qwen3.8-Flash-Next at Q2_0.
Download 70 GB · needs 48 GB system RAM.
Download the NVIDIA · CUDA 12 (legacy) build.
Specifications
| VRAM | 16 GB |
|---|
| Memory bandwidth | 448 GB/s |
|---|
| Reading speed | 1778 tok/s |
|---|
| Writing speed | 48.6 tok/s |
|---|
| Board power | 140 W |
|---|
| Data source | estimated |
|---|
This card is not benchmarked yet. The speeds are estimated from memory bandwidth and will be replaced when we measure it.
See the full benchmark table