Issues / #1941

#1941 GPU flushes and CPU fills

open · @khomouda · 2 コメント · GitHub で見る

AMD / HIPModels & quants

本文

I have an Ultra7 CPU, 32GB memory and 2 GPUs AMD PRO W7800 with 32GB VRAM and AMD PRO W7700 with 16GB VRAM, first time I ran strata with the coder model, it ran fantastic, with 68tps, only on the 7800 then from then on it is offloading the 7800, then flushing GPU and filling the RAM 100% and extremly slow, I tried to use the 2 GPU, sam, it flushes them both and fills RAM, dleted the Strata folder and tried cloning again, alwasys same

関連リンク

インストール・モデル・リリースへの站内リンク。