Issues / #3400

#3400 [GUI] GUI 0.2.0 beta app overwrites JSON config file and does not respect edits done in Expert Mode

closed · @lbarbera · 1 Kommentare · Auf GitHub

Setup & installServer & APINVIDIA / CUDAModels & quantsWindows

Beschreibung

## Strata Version
0.2.0-beta

## Description
After installing and configuring the new Windows GUI, Strata 0.2.0 cannot start Coder IQ_1 as it throws an OOM. The same model starts perfectly if launched from the old START-HERE.bat profile.

This is caused by Strata GUI overwriting some values in the JSON configuration file that are crucial for memory allocation:

- --kv reverts to int8 (was manually set to q4_0)
- --mmap-experts reverts to --resident-experts

The overwrite is observed by monitoring the JSON file, which changes when clicking Retry or Load Mode in the GUI. 

- The GUI SHALL NOT overwrite values that have been manually set in the JSON editor
- The GUI SHALL update its own values after the JSON file has been edited, internally or externally, so they are honored and maintained.

The two files are attached for comparison.

[strata-coder-iq1_m.LEGACY.json](https://github.com/user-attachments/files/33708929/strata-coder-iq1_m.LEGACY.json)
[strata-coder-iq1_m.GUI.json](https://github.com/user-attachments/files/33708928/strata-coder-iq1_m.GUI.json)



## System Configuration
CPU: intel Core i7-9750H
RAM: 32 GB 
GPUs: RTX 2070 8GB
OS: Windows 11
CUDA: Tested on CUDA 12 

## Additional Information
Legacy Strata (the old Python install still present on the same machine) starts correctly with the unmodified JSON file configuration.

Mehr auf der Site

Links zu Install, Modellen, Releases.