Pull requests / #1848

#1848 Seamless CUDA 12 & 13 Docker Support

open · @rafal-prasal · 0 comments · View on GitHub

Setup & installNVIDIA / CUDA

Description

## Seamless CUDA 12 & 13 Docker Support

Issue: Resolves # 

- fixes building of cuda13 docker image (python script embedded within Dockerfile did not work)
- CUDA13 and CUDA12 can be built using the same Dockerfile and Scripting

default is CUDA13, image for cuda12 has to be explicitly given 

## Summary

user may specify CUDA docker base image.

image contains CUDA_VERSION variable, which allows autodiscovery
CUDA12 architectures 60, 61, 70 + flag STRATA_EXPERIMENTAL_SM60=1 
CUDA13 architectures 75, 80, 86, 89, 120 

it saves headache for people, who do not want to mess with their HOST os, and do things in Docker.

## What changed
Dockerfile
- added CUDA_IMAGE argument, default CUDA13
- removed default from CUDA_ARCHITECTURES
- carved out python script, which became docker-build-engine-cuda.py

docker-build-engine-cuda.py (not sure if should not be replaced by setup.py command call)
- autodiscovery of (accordingly to CUDA_VERSION variable provided by nvidia/cuda image)
- - architectures
- - - CUDA12 = 60, 61, 70
- - - CUDA13 = 75, 80, 86, 89, 120 

- - engine directory, 
- - - CUDA12 = engine-cuda12 
- - - CUDA13 = engine 

- - parameter
- - - CUDA12 = STRATA_EXPERIMENTAL_SM60=1

## Extra Notes
changes are absolutely minimal to what was already there and was not working with docker 29.X.X

Related on strata.com

Editorial links to help you install, pick models, or read release notes — not part of the upstream thread.