#6592 [Engine] Inkling-2-Mini --gpus 2 crashes right after load on Windows (2x RTX 5070 Ti): access violation in strata-inkling.exe, server restart loop

open · @jmaher-fas · 1 コメント · GitHub で見る

BenchmarksSetup & installServer & APIMulti-GPUNVIDIA / CUDAModels & quantsWindows

本文

### Area

[Engine]

### Desktop app, Terminal or source?

Source (START-HERE.bat, setup.sh or a build)

### What happened

Inkling-2-Mini with `--gpus 2` (dual-GPU expert parallelism) loads on both cards and then `strata-inkling.exe` crashes with an access violation before it produces anything. It happens with the SQ-20 pack and with Unsloth's UD-Q4_K_XL GGUF alike. The same SQ-20 on one card runs.

- The engine's own bench with `--gpus 2` prints its load line and then dies (Git Bash reports `Segmentation fault`, exit 139):
  ```
  [inkling2-ep] Loaded strata (SQ-20) | gpus=2 (p2p=pinned, ep_split=0.50) | experts: 3072 VRAM (GPU0=7.20 GiB, GPU1=7.40 GiB), 0 host (doorbell=off, numa=1, thr=0) | kv=fp16
  ```
  With the GGUF it's the same: `[inkling2-ep] Loaded gguf (GGUF-NVFP4) | gpus=2 (p2p=pinned, ep_split=0.50) | experts: 3072 VRAM (GPU0=7.26 GiB, GPU1=7.45 GiB), 0 host ...`, then the crash.
- Windows Error Reporting (Application log, event 1000) logged six crash records today, all identical: faulting application and module `strata-inkling.exe` (time stamp `0x6b02b921`), exception code `0xc0000005`, fault offset `0x000000000007bd60`.
- Through `serve/server.py` with `--gpus 2` in the config, the server reports the model loaded, then the engine restarts over and over (7 "engine started" lines in 10 minutes). Requests get `HTTP 503 Service Unavailable`; the ones that ran between restarts decoded at about 10.7 tok/s.
- One card works: setup's own SQ-20 config (GPU 0, `--vram-experts-gb 3.81 --ram-experts-gb 11.87`) stays up, decodes code at about 42 tok/s and passes a tool-call round trip. Its context was auto-sized from 262144 to 33856.

Expected: SQ-20 runs on the two 16 GB cards with every expert in VRAM, as the 0.2.19 notes describe for `--gpus 2`.

Also seen during setup (it may belong in its own issue): `setup.py --setup --family inkling-2-mini --model SQ-20 --gpus 0,1 --context 262144 --vision no --no-start --yes` lists both cards ("GPUs: GPU 0 (NVIDIA GeForce RTX 5070 Ti, 16 GB) + GPU 1 (NVIDIA GeForce RTX 5070 Ti, 16 GB) together"). But it writes a one-GPU config: `"gpu": 0`, `--vram-experts-gb 3.81 --ram-experts-gb 11.87`, and no `--gpus 2`. I added `--gpus 2` and `"gpu": [0, 1]` by hand for the runs above.

### Smallest steps or command that reproduce it

From the installed engine's folder:

```
cd %LOCALAPPDATA%\Strata\components\shapes\inkling2\engine\0.1.65-windows-x86_64-cuda-cuda13
strata-inkling.exe --bench --native <models>\inkling-2-mini\Inkling-2-Mini-SQ-20.strata --gpus 2 --prompt-len 1024 --gen 256
```

It crashed right after the `[inkling2-ep] Loaded` line both times I ran it: once with SQ-20, and once with the GGUF in place of the `.strata` file. The server's restarts crash at the same offset, about 10 s after each start. With `--gpus 1`, the same bench instead stops at load with `strata-inkling CUDA error 2 (out of memory) at ...\ink_cuda.cuh:54` after `experts=2060 VRAM / 1012 host`, which may be related to #6587.

### Reproduction status

Reproduced locally

### Strata version

Strata 0.2.19 (git c6f6427d9) · strata-inkling 0.1.65 (windows-x86_64-cuda-cuda13) · Control 0.1.65

### Graphics card, memory and system

2x RTX 5070 Ti 16 GB (sm_120, driver 621.24; the engine's load line says `p2p=pinned`) · 128 GB RAM · Windows 11 Pro (build 26200)

### Model, size and settings

Inkling-2-Mini SQ-20, and Unsloth's Inkling-2-Mini-UD-Q4_K_XL.gguf · `--gpus 2` · through the server: `--max-context 262144 --draft dspark`, pictures off · the bench: only the flags shown above

### Logs

The server's log only shows the restarts (paths shortened):

```
[strata] 2026-11-22 09:00:24 engine started: ...\0.1.65-windows-x86_64-cuda-cuda13\strata-inkling.exe --serve --native ...\Inkling-2-Mini-SQ-20.strata --max-context 262144 --gpus 2 --draft dspark
[inkling2-ep] Loaded strata (SQ-20) | gpus=2 (p2p=pinned, ep_split=0.50) | experts: 3072 VRAM (GPU0=7.20 GiB, GPU1=7.40 GiB), 0 host (doorbell=off, numa=1, thr=0) | kv=fp16
[strata] 2026-11-22 09:01:18 engine started: (the same)
[strata] 2026-11-22 09:09:15 engine started: (the same)
[strata] 2026-11-22 09:09:28 engine started: (the same)
[strata] 2026-11-22 09:09:41 engine started: (the same)
...
```

Windows Error Reporting, one of the six identical events:

```
Faulting application name: strata-inkling.exe, version: 0.0.0.0, time stamp: 0x6b02b921
Faulting module name: strata-inkling.exe, version: 0.0.0.0, time stamp: 0x6b02b921
Exception code: 0xc0000005
Fault offset: 0x000000000007bd60
```

関連リンク

インストール・モデル・リリースへのサイト内リンク。