Issues / #728

#728 Infinite loop issue

Infinite loop issue

open · @davidliudev · 18 コメント · GitHub で見る

Benchmarks Setup & install Models & quants Windows

本文

Having switch-1.50iq2_xs, 8 bit KV cache, 128k context size, engine version v0.1.38 running out of the box after install on 4090 and 64 GB RAM, Windows 11.

Tried OpenCode and Qwen Coder but both will enter endless loop after a while.
Performance is good at 103 tok/s except when this issue was hit.

Is there anything I can tweak to prevent this?

関連リンク

インストール・モデル・リリースへの站内リンク。