Issues / #2534

#2534 Strata Deck — a web control panel add-on (Linux, battle-tested)

open · @CamTechLinear · 1 comentários · No GitHub

Setup & installServer & APINVIDIA / CUDAModels & quantsDocumentationWindowsLinux

Descrição

Hi Niko — first off, Strata is brilliant. Getting Qwen3.8-Flash-Next running on a 12GB RTX 3060 with this kind of throughput felt like magic in my shop, so thank you.

I built **Strata Deck**, an independent web control panel for Strata hosts, and it's been running production workloads (including live AI-agent traffic) on Linux for a while now. MIT-licensed, no engine internals touched — it drives Strata through its own `run-<model>.sh` / `setup.py` scripts and the `/v1/status` API.

**Repo:** https://github.com/CamTechLinear/strata-deck

What it does:
- **Dashboard** — engine status, GPU/VRAM, RAM, model disk, live timings
- **Model management** — start/switch/stop, install new quants via `setup.py` (resumable), tuner for `strata-<model>.json` with `.bak` safety
- **IN USE guard** — uses the engine's own `activity` counters to block stop/restart while sessions are live, with recent-consumer hostnames shown before you pull the trigger. Built this after learning the hard way that stopping the `serve/server.py` proxy kills client sessions even when the engine stays loaded — a failure invisible to GPU monitoring
- **Stale-path detector** — flags configs pointing at moved/deleted data dirs (the classic post-`--data-dir`-migration footgun)
- **cgroup-safe launches** — models start in their own `systemd-run` units so restarting the panel never touches the serving chain
- **Audit log** — every control action records caller, decision, engine state, consumers

A few ideas in there (stale-path detection, validate-before-stop switching, the proxy-vs-engine distinction) might be worth stealing into the engine itself — happy to help if useful.

Would you be open to linking it as a community add-on in the README? And if there's appetite, I'd like to map out Windows/macOS support — currently it's Linux + systemd user services.

Screenshots are in the repo README. Feedback welcome — and thanks again for Strata.

No site

Links install, modelos, releases.