Issues / #496

#496 RuntimeError("the engine exited before it was ready" + (f" (see {log})" if log else ""))

closed · @AlexBekhtin · 9 comments · View on GitHub

Setup & installServer & APINVIDIA / CUDAModels & quantsWindows

Description

With Coder model result is same. 
Windows 11
```
Strata - Qwen3.8-Flash-Next on a normal PC (a GPU + system RAM + CPU)
  Found your earlier install in D:\STRATA\Strata-main_old (q2_0): setting up this copy the same way - the model files are reused, nothing big is downloaded.

=== Step 1: checking your PC ===
  [ok] GPU: NVIDIA GeForce RTX 3060 Laptop GPU, 6.0 GB VRAM, compute capability 8.6, driver 617.14
  [!]  less than 12 GB of VRAM: Strata will run, but most experts stay on the CPU and it will be slow
  [ok] RAM: 64 GB
  [ok] CPU: Intel(R) Core(TM) i5-10500H CPU @ 2.50GHz (AVX2)

=== Step 2: your choices ===
  [ok] model: Qwen3.8-Flash-Next

  1) Q2_0     2-bit, the fastest; download 66 GB, uses ~34 GB of RAM
  2) IQ2_XS   2-bit i-quant, a little better quality, close in speed; download 68 GB, uses ~36 GB of RAM
  3) IQ3_XXS  3-bit i-quant, better quality, slower (more CPU work per token); download 76 GB, uses ~43 GB of RAM
  4) IQ3_S    3.5-bit i-quant, the best quality (matches the full model), the slowest; needs a 64 GB PC with little else running; download 84 GB, uses ~50 GB of RAM
  [ok] size: Q2_0
  [ok] context: 32768 tokens
  [ok] KV cache: 8-bit
  [ok] images: off
  [ok] experimental speed projection: off

=== Step 3: Python packages ===
  Installing numpy, jinja2, regex, pyyaml, tqdm, requests, cmake, ninja, pillow, psutil ...
  > D:\STRATA\Strata\.venv\Scripts\python.exe -m pip install --quiet --disable-pip-version-check numpy==2.5.3; python_version >= "3.12" numpy==2.4.6; python_version == "3.11" numpy==2.2.6; python_version < "3.11" jinja2==3.1.6 regex==2026.9.10 pyyaml==6.0.3 tqdm==4.70.1 requests==2.34.2 cmake==4.4.3 ninja==1.13.2 pillow==12.3.0 psutil==7.2.2 markupsafe==3.0.3 certifi==2026.7.22 charset-normalizer==3.5.1 idna==3.20 urllib3==2.8.0 colorama==0.4.6; sys_platform == "win32"
  [ok] numpy, jinja2, regex, pyyaml, tqdm, requests, cmake, ninja, pillow, psutil installed

=== Step 4: the Strata engine ===
  llama.cpp source:    39.6 MB
  [ok] llama.cpp source downloaded
  [ok] llama.cpp 3cf0325 (gguf-py, ggml, mtmd)
  Downloading the ready-made Strata engine ...
  Strata engine:   0.12 / 0.12 GB (94%)
  [ok] Strata engine downloaded
  [ok] ready-made engine 0.1.35 for sm_75, sm_86, sm_89, sm_120 (CUDA 13.0)
  Installing NVIDIA CUDA libraries (cuBLAS, CUDA runtime; ~0.4 GB) ...
  > D:\STRATA\Strata\.venv\Scripts\python.exe -m pip install --quiet --disable-pip-version-check nvidia-cublas==13.0.2.14 nvidia-cuda-runtime==13.0.96
  [ok] NVIDIA CUDA libraries (cuBLAS, CUDA runtime; ~0.4 GB) installed
  [ok] engine: D:\STRATA\Strata\engine\strata.exe

=== Step 5: downloading Qwen3.8-Flash-Next Q2_0 ===
  [ok] Qwen3.8-Flash-Next-GSQ-RCO-Q2_0-00001-of-00002.gguf already downloaded
  [ok] Qwen3.8-Flash-Next-GSQ-RCO-Q2_0-00002-of-00002.gguf already downloaded
  [ok] model files present

=== Step 6: preparing the model for Strata ===
  [ok] model prepared: D:\STRATA\Strata-data\packs\q2_0
  [ok] MTP draft layer: D:\STRATA\Strata-data\mtp\rt

=== Step 7: writing the start script ===
  [ok] start script: run-q2_0.bat

All set.
  API (OpenAI):     http://127.0.0.1:8080/v1   (any API key; model name: anything)
  API (Anthropic):  http://127.0.0.1:8080/v1/messages
  Next time:        just run START-HERE.bat (or run-q2_0.bat) - it starts right away
  [ok] GPU: GPU 0 (NVIDIA GeForce RTX 3060 Laptop GPU, 6 GB)

  ----------------------------------------------------------------------------------------------------
  Starting qwen3.8-flash-next-q2_0: it loads about 38 GB into RAM and locks part of it for the GPU.
  While it does, YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES (longer the first time after a
  restart). That is normal: please wait and don't close this window - the browser opens when it is ready.
  Later, closing this window stops the model.
  ----------------------------------------------------------------------------------------------------
loading the model (the first start takes a minute or two) ...
[strata] starting the engine: reading the model's weights ...
[strata] loading the experts into RAM (about 38 GB) and locking part of them for the GPU.
         YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES NOW - this is normal.
         Please wait and don't close this window; the browser opens when it is ready.
[strata] experts loaded: 31.64 GiB at 3.17 GiB/s (15 s so far)
[strata] almost ready ...
Traceback (most recent call last):
  File "D:\STRATA\Strata\serve\server.py", line 2619, in <module>
    sys.exit(main())
             ~~~~^^
  File "D:\STRATA\Strata\serve\server.py", line 2496, in main
    engine = StrataEngine(exe, engine_args(cfg), cwd=cfg.get("cwd"), log=cfg.get("log"), env=env, lazy=lazy)
  File "D:\STRATA\Strata\serve\server.py", line 262, in __init__
    raise RuntimeError("the engine exited before it was ready" + (f" (see {log})" if log else ""))
RuntimeError: the engine exited before it was ready (see D:\STRATA\Strata\strata-q2_0.log)
```

Related on this site

Quick links to related pages.