Issues / #507

#507 Naive question about context window

closed · @jefmud · 3 commentaires · Sur GitHub

Setup & installModels & quants

Description

(Note that, I did set up the repository with UV Python (since I can readily version hop) and substituted all the "pip" calls with "uv pip" --  Which worked without a hitch.)

**I think Strata is pretty awesome.  Your wizardry with my 64 GB RAM/16GB VRAM is quite impressive.**  I easily tested Qwen3.8 Next (although heavily quantized) successfully both in the Browser and the Pi programming harness.  I generated around 40 t/s for the session.

However, when I hit my maximum context in Pi, I got an error message stating I had "error: hit maximum context" I was expecting a compacting stage but it wouldn't proceed. **Did I do something wrong in setup or is this a feature yet to be fully developed?**

Feel free to close the issue if compaction is not goal.

Thanks and keep up the good work!
J

Sur le site

Liens install, modèles, releases.