Issues / #2534
#2534 Strata Deck — a web control panel add-on (Linux, battle-tested)
open · @CamTechLinear · 1 comentários · No GitHub
Setup & installServer & APINVIDIA / CUDAModels & quantsDocumentationWindowsLinux
Descrição
Hi Niko — first off, Strata is brilliant. Getting Qwen3.8-Flash-Next running on a 12GB RTX 3060 with this kind of throughput felt like magic in my shop, so thank you. I built **Strata Deck**, an independent web control panel for Strata hosts, and it's been running production workloads (including live AI-agent traffic) on Linux for a while now. MIT-licensed, no engine internals touched — it drives Strata through its own `run-<model>.sh` / `setup.py` scripts and the `/v1/status` API. **Repo:** https://github.com/CamTechLinear/strata-deck What it does: - **Dashboard** — engine status, GPU/VRAM, RAM, model disk, live timings - **Model management** — start/switch/stop, install new quants via `setup.py` (resumable), tuner for `strata-<model>.json` with `.bak` safety - **IN USE guard** — uses the engine's own `activity` counters to block stop/restart while sessions are live, with recent-consumer hostnames shown before you pull the trigger. Built this after learning the hard way that stopping the `serve/server.py` proxy kills client sessions even when the engine stays loaded — a failure invisible to GPU monitoring - **Stale-path detector** — flags configs pointing at moved/deleted data dirs (the classic post-`--data-dir`-migration footgun) - **cgroup-safe launches** — models start in their own `systemd-run` units so restarting the panel never touches the serving chain - **Audit log** — every control action records caller, decision, engine state, consumers A few ideas in there (stale-path detection, validate-before-stop switching, the proxy-vs-engine distinction) might be worth stealing into the engine itself — happy to help if useful. Would you be open to linking it as a community add-on in the README? And if there's appetite, I'd like to map out Windows/macOS support — currently it's Linux + systemd user services. Screenshots are in the repo README. Feedback welcome — and thanks again for Strata.
No site
Links install, modelos, releases.