Issues / #3368
#3368 [Other] error detected in the compilation of Strata/src/qwen35/q36_engine.cu
open · @Anceloth · 1 comentarios · En GitHub
Descripción
# Problem:
* After pull request on Oct-19: 22:00:00 - the compilation is failing when it is trying to Build the CUDA object CMakeFiles/strata_qwen35.dir/src/qwen35/q36_engine.cu.o
* I started with "./setup --setup" and choose the original model "_Qwen3.8-Flash-Next GSQ-RCO quants by ISTA-DASLab - the original model_", and after some seconds it show an error:
```bash
/path/to/repo/Strata/src/qwen35/q36_engine.cu(1659): error: calling a __device__ function("__half_as_ushort( ::__half)") from a __host__ function("verify_q8") is not allowed
1 error detected in the compilation of "/path/to/repo/Strata/src/qwen35/q36_engine.cu".
ninja: build stopped: subcommand failed.
[X] command failed (exit 2): cmake
Setup stopped. Fix the item above and run it again - everything already done is kept and skipped.
```
* The thing is that the model worked before the pull request. I went back to commit `4c968e61999d237caed3139e6a714d0de52afe82` with description : `gdn chunk / Volta recurrence: name the kernels in every device pass (wmma body .....` and I could run the model
# Environment:
* Ubuntu 24.04,
* GPU RTX 2000 Ada Generation Laptop GPU, 8 GB,
* 64 RAM,
* i7 13th
# Reproduce:
* run `./setup --setup`
* choose : 1) Qwen3.8-Flash-Next
FAIL
# Expected:
* Go through the setup process as usual and run the model
# Evidence: -- log Extended
```bash
/path/to/repo/Strata/src/prefill/moe_fused_iq.cu(1331): warning #177-D: function "strata::prefill::fused::<unnamed>::f16_d" was declared but never referenced
[5/21] Building CUDA object CMakeFiles/strata_qwen35.dir/src/qwen35/q36_engine.cu.o
FAILED: [code=2] CMakeFiles/strata_qwen35.dir/src/qwen35/q36_engine.cu.o
/usr/bin/nvcc -forward-unknown-to-host-compiler -DSTRATA_NATIVE_EXPERTS=1 -DSTRATA_PREFILL_FUSED=1 -DSTRATA_PREFILL_MMQ=1 -DSTRATA_Q36_CPU_POOL=1 -DSTRATA_Q6K_EXPERTS=1 -DSTRATA_VERSION=\"0.1.45.3\" -I/path/to/repo/Strata/include -I/path/to/repo/Strata/third_party/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=c++20 "--generate-code=arch=compute_89,code=[compute_89,sm_89]" -MD -MT CMakeFiles/strata_qwen35.dir/src/qwen35/q36_engine.cu.o -MF CMakeFiles/strata_qwen35.dir/src/qwen35/q36_engine.cu.o.d -x cu -c /path/to/repo/Strata/src/qwen35/q36_engine.cu -o CMakeFiles/strata_qwen35.dir/src/qwen35/q36_engine.cu.o
/path/to/repo/Strata/include/strata/core/family_layout.hpp(100): warning #811-D: const variable "c" requires an initializer -- class "strata::core::ModelGeometry" has no user-provided default constructor
Remark: The warnings can be suppressed with "-diag-suppress <warning-number>"
/path/to/repo/Strata/src/qwen35/q36_engine.cu(1659): error: calling a __device__ function("__half_as_ushort( ::__half)") from a __host__ function("verify_q8") is not allowed
1 error detected in the compilation of "/path/to/repo/Strata/src/qwen35/q36_engine.cu".
[18/21] Building CUDA object CMakeFiles/strata_mmq.dir/ggml-tq-overlay/template-instances/mmq-instance-tqk6.cu.o
ninja: build stopped: subcommand failed.
(the build stopped - trying it once more)
> /usr/bin/cmake --build /path/to/repo/Strata/build --target strata -j 14
[2/4] Building CUDA object CMakeFiles/strata_qwen35.dir/src/qwen35/q36_engine.cu.o
FAILED: [code=2] CMakeFiles/strata_qwen35.dir/src/qwen35/q36_engine.cu.o
/usr/bin/nvcc -forward-unknown-to-host-compiler -DSTRATA_NATIVE_EXPERTS=1 -DSTRATA_PREFILL_FUSED=1 -DSTRATA_PREFILL_MMQ=1 -DSTRATA_Q36_CPU_POOL=1 -DSTRATA_Q6K_EXPERTS=1 -DSTRATA_VERSION=\"0.1.45.3\" -I/path/to/repo/Strata/include -I/path/to/repo/Strata/third_party/llama.cpp/ggml/src/../include -O3 -DNDEBUG -std=c++20 "--generate-code=arch=compute_89,code=[compute_89,sm_89]" -MD -MT CMakeFiles/strata_qwen35.dir/src/qwen35/q36_engine.cu.o -MF CMakeFiles/strata_qwen35.dir/src/qwen35/q36_engine.cu.o.d -x cu -c /path/to/repo/Strata/src/qwen35/q36_engine.cu -o CMakeFiles/strata_qwen35.dir/src/qwen35/q36_engine.cu.o
/path/to/repo/Strata/include/strata/core/family_layout.hpp(100): warning #811-D: const variable "c" requires an initializer -- class "strata::core::ModelGeometry" has no user-provided default constructor
Remark: The warnings can be suppressed with "-diag-suppress <warning-number>"
/path/to/repo/Strata/src/qwen35/q36_engine.cu(1659): error: calling a __device__ function("__half_as_ushort( ::__half)") from a __host__ function("verify_q8") is not allowed
1 error detected in the compilation of "/path/to/repo/Strata/src/qwen35/q36_engine.cu".
ninja: build stopped: subcommand failed.
[X] command failed (exit 2): cmake
Setup stopped. Fix the item above and run it again - everything already done is kept and skipped.
```
--------------
## Thank you in advance En el sitio
Enlaces a install, modelos, releases.