Issues / #654

#654 HIP (gfx1200) RuntimeError Exception Code: 0xC0000005

open · @remielowik · 10 comentarios · En GitHub

Setup & installServer & APIAMD / HIPModels & quantsSecurityWindows

Descripción

Ran the start-here.bat and it downloaded & tried to start but it simply fails with a stacktrace:

Strata - Qwen3.8-Flash-Next on a normal PC (a GPU + system RAM + CPU)
  [ok] GPU: AMD Radeon RX 9060 XT (16 GB, AMD)

  ----------------------------------------------------------------------------------------------------
  Starting qwen3.8-flash-next-iq3_xxs: it loads about 47 GB into RAM and locks part of it for the GPU.
  While it does, YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES (longer the first time after a
  restart). That is normal: please wait and don't close this window - the browser opens when it is ready.
  Later, closing this window stops the model.
  ----------------------------------------------------------------------------------------------------
  Settings (strata-iq3_xxs.json): --expert-cache auto --prefill auto --spec 4 --spec-min-p 0.5
    --max-context 65536 --kv int8 --resident-experts --control-vector-layer-range 4 --cvec-mode project
    --cvec-dir per-layer; server 127.0.0.1:8080
loading the model (the first start takes a minute or two) ...
[strata] starting the engine: reading the model's weights ...
Traceback (most recent call last):
  File "C:\Users\Remie\Desktop\llama\strata\serve\server.py", line 3060, in <module>
    sys.exit(main())
             ^^^^^^
  File "C:\Users\Remie\Desktop\llama\strata\serve\server.py", line 2925, in main
    engine = StrataEngine(exe, engine_args(cfg), cwd=cfg.get("cwd"), log=cfg.get("log"), env=env, lazy=lazy)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Remie\Desktop\llama\strata\serve\server.py", line 362, in __init__
    raise RuntimeError("the engine exited before it was ready" + (f" (see {log})" if log else "") +
RuntimeError: the engine exited before it was ready (see C:\Users\Remie\Desktop\llama\strata\strata-iq3_xxs.log)
the engine log's last lines:
  Exception Code: 0xC0000005
  0x00007FF8FE603DF0, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x453DF0 byte(s), hipProfilerRegisterChunkCallbackExt() + 0xAD570 byte(s)
  0x00007FF8FE5F4D7D, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x444D7D byte(s), hipProfilerRegisterChunkCallbackExt() + 0x9E4FD byte(s)
  0x00007FF8FE5F0E43, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x440E43 byte(s), hipProfilerRegisterChunkCallbackExt() + 0x9A5C3 byte(s)
  0x00007FF8FE5F03FA, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x4403FA byte(s), hipProfilerRegisterChunkCallbackExt() + 0x99B7A byte(s)
  0x00007FF8FE5F4B7C, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x444B7C byte(s), hipProfilerRegisterChunkCallbackExt() + 0x9E2FC byte(s)
  0x00007FF8FE5F48C7, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x4448C7 byte(s), hipProfilerRegisterChunkCallbackExt() + 0x9E047 byte(s)
  0x00007FF8FE5F81A1, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x4481A1 byte(s), hipProfilerRegisterChunkCallbackExt() + 0xA1921 byte(s)
  0x00007FF8FE600DCD, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x450DCD byte(s), hipProfilerRegisterChunkCallbackExt() + 0xAA54D byte(s)
  0x00007FF8FE5CDFFD, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x41DFFD byte(s), hipProfilerRegisterChunkCallbackExt() + 0x7777D byte(s)
  0x00007FF8FE58D02D, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x3DD02D byte(s), hipProfilerRegisterChunkCallbackExt() + 0x367AD byte(s)
  0x00007FF8FE59ECB9, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x3EECB9 byte(s), hipProfilerRegisterChunkCallbackExt() + 0x48439 byte(s)
  0x00007FF8FE5699AF, C:\Users\Remie\Desktop\llama\strata\engine\amdhip64_7.dll(0x00007FF8FE1B0000) + 0x3B99AF byte(s), hipProfilerRegisterChunkCallbackExt() + 0x1312F byte(s)
  0x00007FF9C459259D, C:\WINDOWS\System32\KERNEL32.DLL(0x00007FF9C4580000) + 0x1259D byte(s), BaseThreadInitThunk() + 0x1D byte(s)
  0x00007FF9C652AF78, C:\WINDOWS\SYSTEM32\ntdll.dll(0x00007FF9C64D0000) + 0x5AF78 byte(s), RtlUserThreadStart() + 0x28 byte(s)
Press any key to continue . . .

En el sitio

Enlaces a install, modelos, releases.