Issues / #1941

#1941 GPU flushes and CPU fills

open · @khomouda · 2 comments · View on GitHub

AMD / HIPModels & quants

Description

I have an Ultra7 CPU, 32GB memory and 2 GPUs AMD PRO W7800 with 32GB VRAM and AMD PRO W7700 with 16GB VRAM, first time I ran strata with the coder model, it ran fantastic, with 68tps, only on the 7800 then from then on it is offloading the 7800, then flushing GPU and filling the RAM 100% and extremly slow, I tried to use the 2 GPU, sam, it flushes them both and fills RAM, dleted the Strata folder and tried cloning again, alwasys same

Related on strata.com

Editorial links to help you install, pick models, or read release notes — not part of the upstream thread.