Pull requests / #2298

#2298 community benchmark: RTX 4080 SUPER, Qwen3.8-Flash-Next IQ2_XS

open · @johlim · 0 comentários · No GitHub

BenchmarksNVIDIA / CUDAModels & quantsDocumentationWindows

Descrição

Community speed report: RTX 4080 SUPER + Qwen3.8-Flash-Next IQ2_XS on Windows 11.

Report: bench/results/2026-10-14-community-rtx-4080-super-qwen3-8-flash-next-iq2-xs-2 (README.md + results.json, suite 1, 3 runs per test, thinking off).

Machine: RTX 4080 SUPER 16 GB, i7-9700K, Windows 11, driver 617.42, CUDA 13.4, engine 0.1.43.1, context 131072, KV int8 with streaming.

Medians: short-chat decode 61.1 tok/s, 4K-prompt prefill 1368.0 tok/s, 16K-prompt prefill 2454.3 tok/s, agent follow-up decode 73.8 tok/s at 68.8% conversation-cache hit.

Checked README.md and results.json for private data (paths, user/host names, IPs, keys): none found.

No site

Links install, modelos, releases.