问题 / #496
#496 RuntimeError("the engine exited before it was ready" + (f" (see {log})" if log else ""))
closed · @AlexBekhtin · 9 评论 · 去 GitHub 看
Setup & installServer & APINVIDIA / CUDAModels & quantsWindows
说明
With Coder model result is same.
Windows 11
```
Strata - Qwen3.8-Flash-Next on a normal PC (a GPU + system RAM + CPU)
Found your earlier install in D:\STRATA\Strata-main_old (q2_0): setting up this copy the same way - the model files are reused, nothing big is downloaded.
=== Step 1: checking your PC ===
[ok] GPU: NVIDIA GeForce RTX 3060 Laptop GPU, 6.0 GB VRAM, compute capability 8.6, driver 617.14
[!] less than 12 GB of VRAM: Strata will run, but most experts stay on the CPU and it will be slow
[ok] RAM: 64 GB
[ok] CPU: Intel(R) Core(TM) i5-10500H CPU @ 2.50GHz (AVX2)
=== Step 2: your choices ===
[ok] model: Qwen3.8-Flash-Next
1) Q2_0 2-bit, the fastest; download 66 GB, uses ~34 GB of RAM
2) IQ2_XS 2-bit i-quant, a little better quality, close in speed; download 68 GB, uses ~36 GB of RAM
3) IQ3_XXS 3-bit i-quant, better quality, slower (more CPU work per token); download 76 GB, uses ~43 GB of RAM
4) IQ3_S 3.5-bit i-quant, the best quality (matches the full model), the slowest; needs a 64 GB PC with little else running; download 84 GB, uses ~50 GB of RAM
[ok] size: Q2_0
[ok] context: 32768 tokens
[ok] KV cache: 8-bit
[ok] images: off
[ok] experimental speed projection: off
=== Step 3: Python packages ===
Installing numpy, jinja2, regex, pyyaml, tqdm, requests, cmake, ninja, pillow, psutil ...
> D:\STRATA\Strata\.venv\Scripts\python.exe -m pip install --quiet --disable-pip-version-check numpy==2.5.3; python_version >= "3.12" numpy==2.4.6; python_version == "3.11" numpy==2.2.6; python_version < "3.11" jinja2==3.1.6 regex==2026.9.10 pyyaml==6.0.3 tqdm==4.70.1 requests==2.34.2 cmake==4.4.3 ninja==1.13.2 pillow==12.3.0 psutil==7.2.2 markupsafe==3.0.3 certifi==2026.7.22 charset-normalizer==3.5.1 idna==3.20 urllib3==2.8.0 colorama==0.4.6; sys_platform == "win32"
[ok] numpy, jinja2, regex, pyyaml, tqdm, requests, cmake, ninja, pillow, psutil installed
=== Step 4: the Strata engine ===
llama.cpp source: 39.6 MB
[ok] llama.cpp source downloaded
[ok] llama.cpp 3cf0325 (gguf-py, ggml, mtmd)
Downloading the ready-made Strata engine ...
Strata engine: 0.12 / 0.12 GB (94%)
[ok] Strata engine downloaded
[ok] ready-made engine 0.1.35 for sm_75, sm_86, sm_89, sm_120 (CUDA 13.0)
Installing NVIDIA CUDA libraries (cuBLAS, CUDA runtime; ~0.4 GB) ...
> D:\STRATA\Strata\.venv\Scripts\python.exe -m pip install --quiet --disable-pip-version-check nvidia-cublas==13.0.2.14 nvidia-cuda-runtime==13.0.96
[ok] NVIDIA CUDA libraries (cuBLAS, CUDA runtime; ~0.4 GB) installed
[ok] engine: D:\STRATA\Strata\engine\strata.exe
=== Step 5: downloading Qwen3.8-Flash-Next Q2_0 ===
[ok] Qwen3.8-Flash-Next-GSQ-RCO-Q2_0-00001-of-00002.gguf already downloaded
[ok] Qwen3.8-Flash-Next-GSQ-RCO-Q2_0-00002-of-00002.gguf already downloaded
[ok] model files present
=== Step 6: preparing the model for Strata ===
[ok] model prepared: D:\STRATA\Strata-data\packs\q2_0
[ok] MTP draft layer: D:\STRATA\Strata-data\mtp\rt
=== Step 7: writing the start script ===
[ok] start script: run-q2_0.bat
All set.
API (OpenAI): http://127.0.0.1:8080/v1 (any API key; model name: anything)
API (Anthropic): http://127.0.0.1:8080/v1/messages
Next time: just run START-HERE.bat (or run-q2_0.bat) - it starts right away
[ok] GPU: GPU 0 (NVIDIA GeForce RTX 3060 Laptop GPU, 6 GB)
----------------------------------------------------------------------------------------------------
Starting qwen3.8-flash-next-q2_0: it loads about 38 GB into RAM and locks part of it for the GPU.
While it does, YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES (longer the first time after a
restart). That is normal: please wait and don't close this window - the browser opens when it is ready.
Later, closing this window stops the model.
----------------------------------------------------------------------------------------------------
loading the model (the first start takes a minute or two) ...
[strata] starting the engine: reading the model's weights ...
[strata] loading the experts into RAM (about 38 GB) and locking part of them for the GPU.
YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES NOW - this is normal.
Please wait and don't close this window; the browser opens when it is ready.
[strata] experts loaded: 31.64 GiB at 3.17 GiB/s (15 s so far)
[strata] almost ready ...
Traceback (most recent call last):
File "D:\STRATA\Strata\serve\server.py", line 2619, in <module>
sys.exit(main())
~~~~^^
File "D:\STRATA\Strata\serve\server.py", line 2496, in main
engine = StrataEngine(exe, engine_args(cfg), cwd=cfg.get("cwd"), log=cfg.get("log"), env=env, lazy=lazy)
File "D:\STRATA\Strata\serve\server.py", line 262, in __init__
raise RuntimeError("the engine exited before it was ready" + (f" (see {log})" if log else ""))
RuntimeError: the engine exited before it was ready (see D:\STRATA\Strata\strata-q2_0.log)
```本站相关内容
相关页面的快捷入口。