Tesla T4G

NVIDIA · Tesla Turing · 16 GB · 2018

Can this card run it?

Yes — run Qwen3.8-Flash-Next at Q2_0.

Download 70 GB · needs 48 GB system RAM.

Download the NVIDIA · CUDA 12 (legacy) build.

Specifications

VRAM16 GB
Memory bandwidth320 GB/s
Reading speed1270 tok/s
Writing speed34.7 tok/s
Board power70 W
Data sourceestimated

This card is not benchmarked yet. The speeds are estimated from memory bandwidth and will be replaced when we measure it.

See the full benchmark table