Pull requests / #163
#163 feat: show prefill speed alongside decode speed in dashboard
closed · @hendrikp · 0 comentários · No GitHub
Descrição
Adds prefill speed to the existing Speed graph, with independent scaling and a darker curve. Both rates use t/s, with prefill displayed on the right. Exposes `prefill_tok_s_mean` using the engine’s existing running mean, excluding cached tokens. <img width="572" height="336" alt="Dashboard showing prefill and decode speed" src="https://github.com/user-attachments/assets/5ba70eaf-3615-4a69-9194-14735c454480" /> Tested with passing server tests and a long prompt + manually.
No site
Links install, modelos, releases.