Issues / #3227
#3227 [Other] FP4-Local setup dies at step 6: ModuleNotFoundError: No module named 'transformers'
open · @Yunado · 0 comentarios · En GitHub
Setup & installNVIDIA / CUDAModels & quantsWindows
Descripción
**Area**: `[Other]` (setup.py, the source installer) **Desktop app, Terminal or source install**: source install (git clone, SETUP.bat) on Windows **What happened** Choosing the NVIDIA FP4-Local (QAD) model in SETUP.bat on a Python env that lacks the converter's packages dies at step 6. `tools/nvfp4_local_pack.py prepare` converts the n-gram table (~20 minutes of the 102 GB checkpoint), then reaches the dense weights, where `install()` imports llama.cpp's converter (`third_party/llama.cpp/conversion/base.py`: `from transformers import AutoConfig`) and the whole prepare exits with `ModuleNotFoundError: No module named 'transformers'`. `setup.py`'s package step only installs `requirements.txt`'s eight runtime packages; torch, transformers and safetensors appear nowhere in it. The user must find and install the three packages by hand and re-run. **Smallest steps or command that reproduces it** 1. fresh clone (or any clone whose `.venv` lacks torch/transformers; check with `.venv\Scripts\python -m pip list`) 2. `SETUP.bat`, pick Qwen3.8-Flash-Next, pick the NVFP4 FP4-Local (NVIDIA QAD) model 3. step 6 prints the PLE shard progress, then the traceback above, exit 1 **Reproduction status**: reproduced on this PC (0.1.45, full timestamped log; the first prepare attempt of 2026-10-19). Static check on e88ee39d (v0.2.0-beta-12): `requirements.txt` and `setup.py` still do not mention torch/transformers, so the fresh-env path still dies. **Environment**: Strata source install @ 477ac13c (v0.1.45), engine package 0.1.45, Microsoft Windows 11 Pro, Python 3.12.0 venv, RTX 5090 + RTX 3070, 96 GB RAM, model `nvidia/Qwen3.8-Flash-Next-FP4-Local` revision b9ce18a **Workaround that worked here**: `.venv` `pip install torch transformers safetensors`, re-run SETUP: the prepare completed (dense.gguf 6.0 GB, experts.bin 63.28 GiB, ple-nvfp4.gguf 320001536 x 90 B marked `nvfp4x16`, mtp/rt) and the model serves. **Fix**: the linked pull request installs a pinned `requirements-nvfp4-local.txt` through the existing `pip_install` immediately before a prepare that actually runs, and makes the tool name the missing package when it is run by hand.
En el sitio
Enlaces a install, modelos, releases.