Pull requests / #1340
#1340 core: retain fixed RAM originals during native async exchanges
open · @CC-David-CC · 0 コメント · GitHub で見る
AMD / HIPNVIDIA / CUDADocumentation
本文
Experimental default-off resident-RAM option. Q8/FP16 KV on RTX PRO 6000 Blackwell, 32K/128K plain and MTP: retains approximately 8 GiB and avoids 13.1-14.0% of counterfactual eviction-download payload. TPS nearly unchanged; enabled outputs and work differ. No isolated speedup or quality-equivalence claim. Default-off exact tokens, ownership/ASan/UBSan and STOP checks passed. 
関連リンク
インストール・モデル・リリースへの站内リンク。