Issues / #2052

#2052 Default multi-GPU recommendation not ideal for asymmetrical GPUs

open · @MaKla89 · 0 comentários · No GitHub

Setup & installMulti-GPU

Descrição

While really providing superior inference speed, the default recommended settings for dual-GPU systems was of (by quite a bit) in my case. So I guess, the recommendation flag should either be simply removed or be explained a bit more detailed.

Details: I run a setup with Ryzen 7 9800X3D, 128 GB DDR5 (6000) , 1 x GeForce 4080 (16 GB) and 1 x GeForce 3060 (12 GB), both GPUs at PCIe 4.0 x8. During the setup process of Strata, I'm being told to use both GPUs as the recommended setting. Yet, processing drops from roughly 1000 tps to rather 250-300tps and decode drops from 70 tps to roughly 40-45 tps when using both GPUs, compared to using the 4080 only. 

I've tried several other settings (using the 3060 as expert-cache only, etc.), but the significantly best choice still is NOT to use the second GPU. 

I guess the setup-recommendation only holds true for symmetrical / identical multi-GPU setups? If that is the case, I'd simply add this detail to the recommendation-explanation in setup. If the second GPU even in asymmetrical should gain speed, I'd need some help for correct setup / config :) 

No site

Links install, modelos, releases.