Issues / #1322

#1322 setup re-run with --vision gpu does not add --vision to an existing config's args

open · @arthurlin1979 · 0 comentários · No GitHub

Setup & installServer & APINVIDIA / CUDAModels & quants

Descrição

## What happened

On a machine whose `strata-*.json` was created earlier without images, re-running setup to enable vision:

```bash
./setup.sh --setup --model IQ3_S --vision gpu --context 262144 --yes
```

writes the `vision` section into the config but leaves `args` without `--vision --vram-reserve-mib 700`. The server then starts the engine without vision and every image request fails with:

> `this engine was started without --vision`

while `/v1/models` still advertises `input_modalities: ["text", "image"]` (taken from the vision section), which is misleading.

## Workaround

Manually append `--vision --vram-reserve-mib 700` to the config's `args` and restart. Verified working on two nodes (RTX 5090, RTX PRO 6000).

## Suspected cause

In `setup.py`, `args += ["--vision", "--vram-reserve-mib", ...]` only runs on the fresh-config path. The re-run path preserves the existing `args` and only adds the `vision` section, so the engine never gets the flag.

## Environment

- Strata at commit `82f46a8` (engine 0.1.38 / 0.1.40, local build, CUDA 13.2, sm_120)
- Ubuntu 24.04, RTX 5090 32GB / RTX PRO 6000 96GB
- Qwen3.8-Flash-Next IQ3_S

No site

Links install, modelos, releases.