Issues / #534
#534 Performance, RTX3060 vs RX7800XT
closed · @blastbeng · 3 comentários · No GitHub
Setup & installAMD / HIPNVIDIA / CUDAModels & quants
Descrição
Hello, in my setup i have a RTX3060 12GB, RX7800XT 16GB, 7800x3d cpu and 64gb of ram I am using ubuntu 26 LTS. Strata is awesome, i did a lot of tests but in my experience i had better luck using the 'OLD' RTX 3060 instead of my powerful RX7800XT with HIP. Why? I am using swift1.5 IQ3_XXS (128k context kv q8) and getting around 30/35 TOKS WIth RX7800XT I was getting 40/45 TOKS but the system was unstable, it was crashing the GUI and all the apps, systemd-oomd was constantly killing apps and also killing STRATA. That is not happening using CUDA on the 3060 with same setup as the one i was using with the RX7800XT, why? Is the HIP implementation still experimental, so for my setup is better to go with CUDA? What could i do to get my RX7800XT to work correctly without systemd-oomd to kill everything? Thanks in advance
No site
Links install, modelos, releases.