Issues / #2624

#2624 Support for AMD Instinct MI100 and MI210 GPUs

open · @bioxuxuan · 0 comentarios · En GitHub

AMD / HIP

Descripción

### Background
Currently, Strata has amazing support for many consumer and legacy AMD GPUs (like MI50/MI60), but it doesn't seem to support enterprise/datacenter AMD Instinct MI100 (gfx908) and MI210 (gfx90a) cards yet. 

### Proposed Feature
I would love to see official compilation support or runtime compatibility for AMD Instinct MI100 and MI210 GPUs. Since these cards have large VRAM capacities, they would be absolutely perfect for running Strata's high-speed local inference.

Specifically, hoping to see support for:
- **MI100** (gfx908 architecture)
- **MI210** (gfx90a architecture)

### Current Alternatives
Users with these enterprise cards currently have to stick with other backends like vLLM, but we are missing out on the incredible performance and optimizations that Strata offers.

### Future Plans & Testing
Are there any plans or roadmap milestones to bring support for CDNA-based Instinct cards (MI100/MI200 series) in the near future? 

I have access to MI100/MI210 hardware and would be more than happy to help test any experimental branches or provide logs if needed!

En el sitio

Enlaces a install, modelos, releases.