Pull requests / #163
#163 feat: show prefill speed alongside decode speed in dashboard
closed · @hendrikp · 0 commentaires · Sur GitHub
Description
Adds prefill speed to the existing Speed graph, with independent scaling and a darker curve. Both rates use t/s, with prefill displayed on the right. Exposes `prefill_tok_s_mean` using the engine’s existing running mean, excluding cached tokens. <img width="572" height="336" alt="Dashboard showing prefill and decode speed" src="https://github.com/user-attachments/assets/5ba70eaf-3615-4a69-9194-14735c454480" /> Tested with passing server tests and a long prompt + manually.
Sur le site
Liens install, modèles, releases.