#6045 [Engine] SYCL: int8 ESIMD prompt attention fails qsa_prompt_attn_parity on Arc Pro B70
open · @RichAyotte · 3 コメント · GitHub で見る
本文
### Area [Engine] ### Desktop app, Terminal or source? Source (a build) ### What happened `qsa_prompt_attn_parity` fails on an Arc Pro B70. The three int8 batched cases on the int8 DPAS (ESIMD) prompt-attention path are off by about 3e-4 against the FP64 reference. Every other case, including int8 per-cell on the same path, is within about 5e-6. With `STRATA_PROMPT_ATTN_ESIMD=0` all 12 cases pass, so the failure is specific to the ESIMD path, which is on by default for Battlemage since 8401c21f. ESIMD on, as ctest runs it (`qsa_prompt_attn_parity 8192 512 2`), the three failing lines: ``` strata: prompt attention on the int8 DPAS (ESIMD) FAIL int8 ctx 8192, 512 queries: vs FP64 old 1.72e-06 new 0.000309 (output scale 3.3); new vs old 0.000459 (0.00012 of scale); 11.245 -> 1.904 ms per chunk (5.91x) FAIL int8 ctx 1500, 512 queries: vs FP64 old 1.9e-06 new 0.000291 (output scale 3.76); new vs old 0.000508 (0.00014 of scale); 7.276 -> 1.063 ms per chunk (6.84x) FAIL int8 ctx 2100, 256 queries: vs FP64 old 2.04e-06 new 0.000319 (output scale 3.61); new vs old 0.000412 (0.00011 of scale); 5.478 -> 0.912 ms per chunk (6.01x) FAILURES: 3 ``` The same command with `STRATA_PROMPT_ATTN_ESIMD=0`, the same three cases: ``` PASS int8 ctx 8192, 512 queries: vs FP64 old 1.72e-06 new 1.87e-06 (output scale 3.3); new vs old 4.47e-06 (1.2e-06 of scale); 11.289 -> 27.311 ms per chunk (0.41x) PASS int8 ctx 1500, 512 queries: vs FP64 old 1.9e-06 new 1.96e-06 (output scale 3.76); new vs old 3.4e-06 (9e-07 of scale); 7.284 -> 18.595 ms per chunk (0.39x) PASS int8 ctx 2100, 256 queries: vs FP64 old 2.04e-06 new 1.72e-06 (output scale 3.61); new vs old 3.81e-06 (1.1e-06 of scale); 5.523 -> 15.178 ms per chunk (0.36x) FAILURES: 0 ``` Run directly with no arguments, the binary fails three int8 batched cases as well (ctx 32768 with 2048 queries, ctx 1500 with 1500 queries, ctx 2100 with 256 queries), the same way on two runs. ### Smallest steps or command that reproduce it From a SYCL build of main at 13eedf55 (`bash sycl/tools/build.sh`), with the oneAPI environment loaded: ```sh cd build-sycl ./qsa_prompt_attn_parity 8192 512 2 STRATA_PROMPT_ATTN_ESIMD=0 ./qsa_prompt_attn_parity 8192 512 2 ``` ### Reproduction status Reproduced locally ### Strata version engine 0.1.59.1, source build of 13eedf55 ### Graphics card, memory and system Arc Pro B70 32 GB · 94 GB RAM · Debian sid, Linux 7.3.4 · oneAPI 2026.2 icpx · JIT build (no AOT) ### Model, size and settings None: this is the synthetic parity test. Every run above was made while a Strata server held 30.4 GB of the card's VRAM. The ESIMD-off run passed under the same conditions. Not run on an idle card. ### Logs The rest of the ESIMD-on run: the int8 per-cell, fp16 and q4_0 cases all pass (for example `PASS int8 per-cell: vs FP64 2.65e-06 (warp kernel 1.72e-06)`).
関連リンク
インストール・モデル・リリースへのサイト内リンク。