Pull requests / #118

#118 serve: routing traces from the live server

closed · merged 2026-09-29 · @maedoc · 0 comments · View on GitHub

Server & API

Description

Two gaps kept the routing trace one-shot-only:

- drive_pool_multi, the verify-window dispatch the serve path uses for every decode call, had no trace hook; --dump-routing under --serve opened the file and wrote nothing. Records now go out per token in drive_pool's format (layer, k, ids, weights). The multi dispatch fuses the router weights into the kernel and does not surface them, so records carry unit weights: make_profile.py ranks pairs by routed frequency, which is the signal that matters; a one-shot run still records true weights.
- the trace sat in a stdio buffer until teardown, so a crash lost the whole session's data. It now flushes at every request's DONE.

Verified live: a serve-mode trace grows per request, parses cleanly in make_profile.py's format (all 48 layers, records per decode position), and captures real multi-session traffic for expert-profile building.

Related on strata.com

Editorial links to help you install, pick models, or read release notes — not part of the upstream thread.