Pull requests / #2298
#2298 community benchmark: RTX 4080 SUPER, Qwen3.8-Flash-Next IQ2_XS
open · @johlim · 0 comentários · No GitHub
BenchmarksNVIDIA / CUDAModels & quantsDocumentationWindows
Descrição
Community speed report: RTX 4080 SUPER + Qwen3.8-Flash-Next IQ2_XS on Windows 11. Report: bench/results/2026-10-14-community-rtx-4080-super-qwen3-8-flash-next-iq2-xs-2 (README.md + results.json, suite 1, 3 runs per test, thinking off). Machine: RTX 4080 SUPER 16 GB, i7-9700K, Windows 11, driver 617.42, CUDA 13.4, engine 0.1.43.1, context 131072, KV int8 with streaming. Medians: short-chat decode 61.1 tok/s, 4K-prompt prefill 1368.0 tok/s, 16K-prompt prefill 2454.3 tok/s, agent follow-up decode 73.8 tok/s at 68.8% conversation-cache hit. Checked README.md and results.json for private data (paths, user/host names, IPs, keys): none found.
No site
Links install, modelos, releases.