Issues / #2624
#2624 Support for AMD Instinct MI100 and MI210 GPUs
open · @bioxuxuan · 0 comentários · No GitHub
Descrição
### Background Currently, Strata has amazing support for many consumer and legacy AMD GPUs (like MI50/MI60), but it doesn't seem to support enterprise/datacenter AMD Instinct MI100 (gfx908) and MI210 (gfx90a) cards yet. ### Proposed Feature I would love to see official compilation support or runtime compatibility for AMD Instinct MI100 and MI210 GPUs. Since these cards have large VRAM capacities, they would be absolutely perfect for running Strata's high-speed local inference. Specifically, hoping to see support for: - **MI100** (gfx908 architecture) - **MI210** (gfx90a architecture) ### Current Alternatives Users with these enterprise cards currently have to stick with other backends like vLLM, but we are missing out on the incredible performance and optimizations that Strata offers. ### Future Plans & Testing Are there any plans or roadmap milestones to bring support for CDNA-based Instinct cards (MI100/MI200 series) in the near future? I have access to MI100/MI210 hardware and would be more than happy to help test any experimental branches or provide logs if needed!
No site
Links install, modelos, releases.