Issues / #3400
#3400 [GUI] GUI 0.2.0 beta app overwrites JSON config file and does not respect edits done in Expert Mode
closed · @lbarbera · 1 comments · View on GitHub
Setup & installServer & APINVIDIA / CUDAModels & quantsWindows
Description
## Strata Version 0.2.0-beta ## Description After installing and configuring the new Windows GUI, Strata 0.2.0 cannot start Coder IQ_1 as it throws an OOM. The same model starts perfectly if launched from the old START-HERE.bat profile. This is caused by Strata GUI overwriting some values in the JSON configuration file that are crucial for memory allocation: - --kv reverts to int8 (was manually set to q4_0) - --mmap-experts reverts to --resident-experts The overwrite is observed by monitoring the JSON file, which changes when clicking Retry or Load Mode in the GUI. - The GUI SHALL NOT overwrite values that have been manually set in the JSON editor - The GUI SHALL update its own values after the JSON file has been edited, internally or externally, so they are honored and maintained. The two files are attached for comparison. [strata-coder-iq1_m.LEGACY.json](https://github.com/user-attachments/files/33708929/strata-coder-iq1_m.LEGACY.json) [strata-coder-iq1_m.GUI.json](https://github.com/user-attachments/files/33708928/strata-coder-iq1_m.GUI.json) ## System Configuration CPU: intel Core i7-9750H RAM: 32 GB GPUs: RTX 2070 8GB OS: Windows 11 CUDA: Tested on CUDA 12 ## Additional Information Legacy Strata (the old Python install still present on the same machine) starts correctly with the unmodified JSON file configuration.
Related on this site
Quick links to related pages.