Pull requests / #276
#276 diagnostics: STRATA_DUMP_FIRST_LOGITS writes the first generated token's logits
closed · @sergqwer · 0 评论 · 在 GitHub 查看
描述
## Summary `STRATA_DUMP_FIRST_LOGITS=<file>` writes the logits of the token the prompt predicts (n_vocab float32, once per run). Two variants of the engine run on the same prompt then give a first-token KL divergence: how far a change moves the model's distribution, not only whether its top token changed. On a layer split the last stage's verifier writes it. This is the measurement behind the precision numbers in the PRs that follow it (#280, #283, #293, ...). These changes come from an NVFP4 fork of Strata (sergqwer/strata-nvfp4), ported onto current main one topic per PR. ## Correctness Off unless the variable is set; nothing else changes. 🤖 Generated with [Claude Code](https://claude.com/claude-code) https://claude.ai/code/session_01VZy1yKaDDiA8a7svdwaHio
站内延伸阅读
链到安装、模型与版本说明,便于 SEO/GEO,非官方 issue 正文。