Issues / #388

#388 Incorrect --max-context flag in configuration

closed · @robinat13 · 0 comments · View on GitHub

Setup & installModels & quants

Description

During intial setup I have selected 256k as context length. Once the Startup script finished setting up the system, in the configuration file "strata-iq3_xxs.json" I can see the following as max context ->

```
 "--max-context",
  "131072",
```

This is missleading 

Related on this site

Quick links to related pages.