OSError: libtorch_cuda.so: cannot open shared object file: No such file or directory

Question

enter image description here I have been stuck with this problem for a while, and I would be very grateful if someone could help me resolve it. The system I am using is Ubuntu with CUDA 12.0.

As mentioned, I have tried uninstalling and reinstalling torchaudio, but I still encounter the same issue.

Answer 1

Happened to me as well. If you installed pytorch with conda, it has some issues recognizing which build is the right one. I guess you have a cpu build, but have pytorch-conda installed and want to use it with the gpu.

To solve it either you run (create a fresh environment otherwise it might not work)

conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia

as described on the pytorch webpage.

Or you can tell conda which build of pytorch you want to have exactly (here are all the builds available, you need one with *cuda* instead of *cpu*)

For example in my case

conda install pytorch=2.1.0=py3.11_cuda11.8_cudnn8.7.0_0 -c pytorch

solved the issue.