#163 feat: show prefill speed alongside decode speed in dashboard

closed · @hendrikp · 0 comments · View on GitHub

Description

Adds prefill speed to the existing Speed graph, with independent scaling and a darker curve. Both rates use t/s, with prefill displayed on the right.

Exposes `prefill_tok_s_mean` using the engine’s existing running mean, excluding cached tokens.

<img width="572" height="336" alt="Dashboard showing prefill and decode speed" src="https://github.com/user-attachments/assets/5ba70eaf-3615-4a69-9194-14735c454480" />

Tested with passing server tests and a long prompt + manually.

Related on strata.com

Install Strata
Model sizes & RAM
Release notes

Editorial links to help you install, pick models, or read release notes — not part of the upstream thread.