Guides

How fast should it be

Reading runs about forty times faster than writing: a card doing 4000 read tok/s writes around 100 tok/s. That is normal, not a misconfiguration — generation is sequential, prompt processing is parallel. Compare your card against the benchmark table before assuming something is wrong.