#545 Error: 400: {"type":"invalid_request_error","message":"prompt (38963 tokens) + max tokens (226281) exceeds the context (262144); requests are never truncated"}

closed · @avarakin · 4 comments · View on GitHub

Description

Getting stuck with this error even after compacting. Increasing context does not help. I am using Pi.dev 1.0 harness. This issue does not happen with qwen 3.8 27b. Machine has 16g VRAM and 64g RAM.

Related on strata.com

Install Strata
Model sizes & RAM
Release notes

Editorial links to help you install, pick models, or read release notes — not part of the upstream thread.