#6400 [Engine] + [Docs] SYCL setup & LXC/multi-GPU flow is a complete mess (paths, build dir, device selection)

open · @lamium2 · 2 comentarios · En GitHub

Setup & installMulti-GPUNVIDIA / CUDADocumentation

Descripción

### Environment
- **Setup:** Native LXC container (no Docker) running Ubuntu 24.04 LTS, installed following `INTEL_ARC.md`
- **System:** 96 GB system RAM (64 GB allocated to the container, no swap), GPU 0: Intel Arc Pro B70 (32 GB) + GPU 1: Intel Arc Pro B60 (24 GB)
- **Model:** `qwen3.8-flash-next-unsloth-ud-iq4_xs`

### Summary of Issues Encountered

1. **Inconsistent build directory expectations (`ROOT` = `engine/` vs. repo root):**
   - Building from repo root (`cmake -S engine -B build-sycl ... -DSTRATA_ENABLE_SYCL=ON`) puts the binary at `build-sycl/sycl/strata`, while `engine/sycl/setup_intel.py` (`sycl_engine()`) only checks `engine/build-sycl-aot/strata` and `engine/build-sycl/strata`.
   - Switching source/build paths (`-S engine/sycl` into an existing `build-sycl`) fails with a CMake source-directory cache mismatch unless cache files are manually removed first.

2. **Models moved to `Strata-data` and then rejected by strict path containment check (`sycl_path()`):**
   - Models previously placed under `Strata/models` were moved by the setup script into `Strata-data`, placing them outside `ROOT.parent` (`Strata`) and causing `<path> is outside /root/Strata, which the SYCL engine's container mounts` unless `STRATA_SYCL_ROOT` is set or directories are placed/symlinked back under `/root/Strata`.

3. **Stale config pointing to non-existent engine binary:**
   - Existing `strata-*.json` configs can retain stale paths (such as `/root/Strata/engine/engine-sycl/strata`) and fail with `refers to missing files` until repaired/recreated.

4. **SYCL falls back to CPU (`Intel(R) Core(TM) Ultra 5 250K Plus`) and `--stream-experts` is missing in the launched engine command:**
   - Even with two Intel Arc cards (Pro B70 + Pro B60), the log shows `--layer-split auto: one GPU visible, so no split`, missing `--stream-experts` (`xe driver without --stream-experts: ...`), and compilation/memory errors on the CPU device (`Unrecognized build options: -ze-opt-greater-than-4GB-buffer-required`, `ext_intel_free_memory is not supported`, and `cudaMalloc ... 0 MiB of 96096 MiB ... free` using system RAM size).

### Relevant Logs
- Server error: `EngineDied: the engine exited before it was ready (see /root/Strata/terminal/strata-unsloth-ud-iq4_xs.log)`
- Engine log shows:
  - `strata generate: --layer-split auto: one GPU visible, so no split`
  - `strata generate: xe driver without --stream-experts: ... Use --stream-experts, as setup configures it`
  - `Build program log for 'Intel(R) Core(TM) Ultra 5 250K Plus': Compilation failed / Unrecognized build options: -ze-opt-greater-than-4GB-buffer-required`
  - `get_memory_info: ext_intel_free_memory is not supported.`
  - `cudaMalloc(1485606400) for the weight arena failed (error): 0 MiB of 96096 MiB VRAM free on this GPU.`

En el sitio

Enlaces a install, modelos, releases.