python scripts/serve.py fails with python scripts/serve.py AssertionError: Torch not compiled with CUDA enabled

[neewb20221]

Fails to run with:

File "C:\Users\*****\AppData\Local\Programs\Python\Python313\Lib\site-packages\torch\cuda\__init__.py", line 403, in _lazy_init raise AssertionError("Torch not compiled with CUDA enabled") AssertionError: Torch not compiled with CUDA enabled

Executing on 3060ti, win10

[loicmagne]

Hi @neewb20221 , I've seen this issue where pytorch doesn't install the CUDA version by default, you need to install it manually

First uninstall PyTorch with pip uninstall torch -y

Then check your CUDA version with nvidia-smi

Finally reinstall PyTorch with the right CUDA version, it should be something like pip install torch torchvision --index-url https://download.pytorch.org/whl/cuXXX (see here)

[neewb20221]

Tnx, helped