All GPUs

RTX 3090 Ti

NVIDIA · Ampere · 24 GB · 2022

Can this card run it?

Yes — run Qwen3.8-Flash-Next at Q2_0.

Download 70 GB · needs 48 GB system RAM.

Download the NVIDIA · CUDA 12 (legacy) build.

Specifications

VRAM24 GB
Memory bandwidth1008 GB/s
Reading speed2255.1 tok/s
Writing speed93.1 tok/s
Board power600 W
Data sourcebenchmarked

These numbers come from our own benchmark runs on this card.

See the full benchmark