Issues / #728
#728 Infinite loop issue

open · @davidliudev · 18 comentários · No GitHub
BenchmarksSetup & installModels & quantsWindows
Descrição
Having switch-1.50iq2_xs, 8 bit KV cache, 128k context size, engine version v0.1.38 running out of the box after install on 4090 and 64 GB RAM, Windows 11. Tried OpenCode and Qwen Coder but both will enter endless loop after a while. Performance is good at 103 tok/s except when this issue was hit. Is there anything I can tweak to prevent this?
No site
Links install, modelos, releases.