The RX 7900 XTX equipped with the iq2-xs quantization delivers approximately 1459 reading tps and 75.5 writing tps under the Strata client, processing prompts and generating tokens within the 24 GB VRAM budget. This setup is fully local, no cloud dependency, and power drawn stays near the measured 475 W under sustained inference.
Why iq2-xs fits the 7900 XTX
The iq2-xs format reduces the model's size while preserving enough precision for practical local inference on the 24 GB of VRAM found in this GPU. It was chosen because the measured reading speed of 1459 tps requires the larger support libraries and avoids the latency spikes seen with more aggressive quantizations. The trade-off is a modest drop in writing speed to about 75.5 tps, which remains usable for interactive chat and small batch generation.
How to verify on your own machine
Run the Strata client, load the iq2-xs variant of the selected model, and use the built‑in benchmarking toggle to record reading and writing tps. Check the VRAM meter during a long run to confirm that usage stays below 24 GB. Observe the power readout of the 479 W board power connector to compare against the measured 475 W draw at idle and under load.
| Metric | Value |
|---|---|
| VRAM usage | 24 GB |
| Reading tps | 1459.3 |
| Writing tps | 75.5 |
| Power draw | 475 W |
The core term "iq2-xs" refers to a 2‑bit quantization variant that balances model size and token generation quality for AMD GPUs, making local inference practical without external compute resources.
Measuring yourself
Open the Strata UI, start a long prompt sequence, watch the live tps counters, then pause and note the VRAM usage and power draw. Repeat after a full system sleep cycle to confirm the numbers stay consistent across reboots.
FAQ
- What hardware is required? The RX 7900 XTX with 24 GB VRAM and a compatible Linux driver is needed.
- Can I use other quantizations? Yes, but iq2-xs gives the best balance of speed and fidelity on this GPU.
- How much does it cost? Electricity cost is about 0.32 €/kWh, so the energy used per hour is roughly 152 € per 480 kWh, but actual cost depends on local rates.