Issues / #1080

#1080 RTX 5000 PRO slow unsloth ud iq4_xs fix

open · @ukrolelo · 4 评论 · 在 GitHub 查看

NVIDIA / CUDAModels & quants

描述

I didin't read what is this settings but i removed this
  "--resident-budget-gib",
  "55",

from the json and now it's flying, otherwise it was dead slow. 262K context, parallel 2, vision cpu
usage 47.1/47.8 VRAM

站内延伸阅读

链到安装、模型与版本说明，便于 SEO/GEO，非官方 issue 正文。