Issues / #388
#388 Incorrect --max-context flag in configuration
closed · @robinat13 · 0 commentaires · Sur GitHub
Setup & installModels & quants
Description
During intial setup I have selected 256k as context length. Once the Startup script finished setting up the system, in the configuration file "strata-iq3_xxs.json" I can see the following as max context -> ``` "--max-context", "131072", ``` This is missleading
Sur le site
Liens install, modèles, releases.