Issues / #3400
#3400 [GUI] GUI 0.2.0 beta app overwrites JSON config file and does not respect edits done in Expert Mode
closed · @lbarbera · 1 コメント · GitHub で見る
Setup & installServer & APINVIDIA / CUDAModels & quantsWindows
本文
## Strata Version 0.2.0-beta ## Description After installing and configuring the new Windows GUI, Strata 0.2.0 cannot start Coder IQ_1 as it throws an OOM. The same model starts perfectly if launched from the old START-HERE.bat profile. This is caused by Strata GUI overwriting some values in the JSON configuration file that are crucial for memory allocation: - --kv reverts to int8 (was manually set to q4_0) - --mmap-experts reverts to --resident-experts The overwrite is observed by monitoring the JSON file, which changes when clicking Retry or Load Mode in the GUI. - The GUI SHALL NOT overwrite values that have been manually set in the JSON editor - The GUI SHALL update its own values after the JSON file has been edited, internally or externally, so they are honored and maintained. The two files are attached for comparison. [strata-coder-iq1_m.LEGACY.json](https://github.com/user-attachments/files/33708929/strata-coder-iq1_m.LEGACY.json) [strata-coder-iq1_m.GUI.json](https://github.com/user-attachments/files/33708928/strata-coder-iq1_m.GUI.json) ## System Configuration CPU: intel Core i7-9750H RAM: 32 GB GPUs: RTX 2070 8GB OS: Windows 11 CUDA: Tested on CUDA 12 ## Additional Information Legacy Strata (the old Python install still present on the same machine) starts correctly with the unmodified JSON file configuration.
関連リンク
インストール・モデル・リリースへのサイト内リンク。