Issues / #507
#507 Naive question about context window
closed · @jefmud · 3 comentarios · En GitHub
Setup & installModels & quants
Descripción
(Note that, I did set up the repository with UV Python (since I can readily version hop) and substituted all the "pip" calls with "uv pip" -- Which worked without a hitch.) **I think Strata is pretty awesome. Your wizardry with my 64 GB RAM/16GB VRAM is quite impressive.** I easily tested Qwen3.8 Next (although heavily quantized) successfully both in the Browser and the Pi programming harness. I generated around 40 t/s for the session. However, when I hit my maximum context in Pi, I got an error message stating I had "error: hit maximum context" I was expecting a compacting stage but it wouldn't proceed. **Did I do something wrong in setup or is this a feature yet to be fully developed?** Feel free to close the issue if compaction is not goal. Thanks and keep up the good work! J
En el sitio
Enlaces a install, modelos, releases.