AMD ROCm provides the necessary open software stack to run large AI models locally on your machine using Strata. By verifying your GPU compatibility and installing the correct drivers, you enable the Strata engine to access your hardware resources directly.
Understanding AMD ROCm
ROCm (Radeon Open Compute) is AMD's platform for high-performance computing. It allows applications to use the parallel processing power of AMD GPUs. This is essential for running large language models locally without relying on cloud services.
Checking Your GPU Compatibility
Not all AMD GPUs support ROCm. You must check if your specific model is on the supported list. Common supported cards include the Radeon RX 7900 XTX and the Radeon Pro W7900. Check the official AMD documentation for the full list of compatible hardware. If your GPU is not listed, you cannot use ROCm for local AI inference.
Installing the Drivers
You need to install the ROCm drivers for your operating system. For Windows, use the AMD Software: Adren Edition. For Linux, install the ROCm packages via your package manager. Ensure you have the latest version to avoid stability issues with the Strata client.
Running Strata with ROCm
Once installed, launch the Strata client. Go to the settings and select ROCm as your backend. The engine will now use your GPU for model loading and inference. This process is fully local and keeps your data private.
Cost and Efficiency
Running models locally saves money on API calls. The cost is just the electricity to run your PC. At $0.17/kWh, the cost is minimal for occasional use. This makes local AI a cost-effective solution for many tasks.
| Component | Specification | Status |
|---|---|---|
| GPU Support | AMD Radeon RX 7000 Series | Verified |
| OS Support | Windows 10/11, Linux | Supported |
| Backend | ROCm | Available |
ROCm is the open software stack that enables AMD GPUs to accelerate computing tasks.