Issues / #2167
#2167 v0.1.43.1 and v0.1.43 are slower than v0.1.42, and outputs that are not truncated in 0.1.42 are truncated before completion in v0.1.43 and v0.1.43.1, with no errors in the logs
open · @zhang2939 · 0 コメント · GitHub で見る
NVIDIA / CUDAModels & quantsWindows
本文
Both v0.1.43.1 and v0.1.43 are slower than v0.1.42. In addition, for some inputs whose outputs are not truncated in v0.1.42, the output is truncated before completion in v0.1.43 and v0.1.43.1. The logs show no issues and are identical to the logs from a complete output.
For these truncated cases, the output always stops right after the following part is generated:
python
response_blocks.append(
f"""<|im_start|>
function: {func_name}
arguments: {json.dumps(args, ensure_ascii=False)}
result: {result}
Environment:
CPU: Intel Core i9-14900KF
GPU: NVIDIA RTX 5090
RAM: 96 GB
OS: Windows 10
Model: Qwen3.8-Flash-Next-GSQ-RCO-GGUF\IQ3_S
[strata-iq3_s_v0.1.42.log](https://github.com/user-attachments/files/33356403/strata-iq3_s_v0.1.42.log)
[strata-iq3_s_v0.1.43.1.log](https://github.com/user-attachments/files/33356402/strata-iq3_s_v0.1.43.1.log)関連リンク
インストール・モデル・リリースへの站内リンク。