Issues / #1941

#1941 GPU flushes and CPU fills

open · @khomouda · 2 commentaires · Sur GitHub

AMD / HIPModels & quants

Description

I have an Ultra7 CPU, 32GB memory and 2 GPUs AMD PRO W7800 with 32GB VRAM and AMD PRO W7700 with 16GB VRAM, first time I ran strata with the coder model, it ran fantastic, with 68tps, only on the 7800 then from then on it is offloading the 7800, then flushing GPU and filling the RAM 100% and extremly slow, I tried to use the 2 GPU, sam, it flushes them both and fills RAM, dleted the Strata folder and tried cloning again, alwasys same

Sur le site

Liens install, modèles, releases.