Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Easier installation of onnxruntime-gpu #20200

Closed
gedoensmax opened this issue Apr 4, 2024 · 2 comments
Closed

[Feature Request] Easier installation of onnxruntime-gpu #20200

gedoensmax opened this issue Apr 4, 2024 · 2 comments
Labels
ep:CUDA issues related to the CUDA execution provider feature request request for unsupported feature or enhancement platform:windows issues related to the Windows platform

Comments

@gedoensmax
Copy link
Contributor

gedoensmax commented Apr 4, 2024

Describe the feature request

I would like to see an easier installation of the pypi package onnxruntime-gpu. Ideally the package will automatically install:

nvidia-cudnn-cuXX 
nvidia-cublas-cuXX
nvidia-cufft-cuXX
nvidia-cuda-runtime-cuXX
nvidia-cudarand-cuXX
tensor-cuXX

Where XX denotes the depending CUDA version. This should work for Linux and windows equally and heavily ease the entrypoint by not requiring putting all the needed libs on the PATH.

Ideally it would even be possible to install the needed libraries for cuda and/or art only by doing pip install onnxruntime-gpu[cuda]
I am happy to contribute or help testing for this, but I could use someone giving me hints where to look.
@jywu-msft for viz

Describe scenario use case

This will positively impact all python users of ONNX Runtime that use GPU acceleration. Hopefully also reducing library installation issues on GitHub significantly.

@gedoensmax gedoensmax added the feature request request for unsupported feature or enhancement label Apr 4, 2024
@github-actions github-actions bot added ep:CUDA issues related to the CUDA execution provider platform:windows issues related to the Windows platform labels Apr 4, 2024
@chilo-ms
Copy link
Contributor

chilo-ms commented Apr 4, 2024

@snnn
Could you help review this feature request and provide some guidance? Thanks!
This can really help users run ORT through package without having to manually do other env setting or dependency downloading.

@snnn
Copy link
Member

snnn commented Apr 8, 2024

Dup with #19350 .

@snnn snnn closed this as completed Apr 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:CUDA issues related to the CUDA execution provider feature request request for unsupported feature or enhancement platform:windows issues related to the Windows platform
Projects
None yet
Development

No branches or pull requests

3 participants