#728 Infinite loop issue

open · @davidliudev · 18 评论 · 在 GitHub 查看

Benchmarks Setup & install Models & quants Windows

描述

Having switch-1.50iq2_xs, 8 bit KV cache, 128k context size, engine version v0.1.38 running out of the box after install on 4090 and 64 GB RAM, Windows 11.

Tried OpenCode and Qwen Coder but both will enter endless loop after a while.
Performance is good at 103 tok/s except when this issue was hit.

Is there anything I can tweak to prevent this?

站内延伸阅读

Install Strata
Model sizes & RAM
Release notes

链到安装、模型与版本说明，便于 SEO/GEO，非官方 issue 正文。