Issues / #388
#388 Incorrect --max-context flag in configuration
closed · @robinat13 · 0 Kommentare · Auf GitHub
Setup & installModels & quants
Beschreibung
During intial setup I have selected 256k as context length. Once the Startup script finished setting up the system, in the configuration file "strata-iq3_xxs.json" I can see the following as max context -> ``` "--max-context", "131072", ``` This is missleading
Mehr auf der Site
Links zu Install, Modellen, Releases.