I'm testing some models and have created virtual environments for them. One of them required PyTorch which I was able to install with no issues. However, for another one, I've made a new virtual environment and when installing flash-attn, it complains about missing pytorch, so I try installing it like so: python3 -m pip install torch Which looks like it succeeds: Requirement already satisfied: torch in ./ATI/lib/python3.12/site-packages (2.7.1) Requirement already satisfied: filelock in ./ATI/lib/python3.12/site-packages (from torch) (3.18.0) Requirement already satisfied: typing-extensions>=4.10.0 in ./ATI/lib/python3.12/site-packages (from torch) (4.14.0) Requirement already satisfied: setuptools in ./ATI/lib/python3.12/site-packages (from torch) (80.9.0) Requirement already satisfied: sympy>=1.13.3 in ./ATI/lib/python3.12/site-packages (from torch) (1.14.0) Requirement already satisfied: networkx in ./ATI/lib/python3.12/site-packages (from torch) (3.5) Requirement already satisfied: jinja2 in ./ATI/lib/python3.12/site-packages (from torch) (3.1.6) Requirement already satisfied: fsspec in ./ATI/lib/python3.12/site-packages (from torch) (2025.5.1) Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.6.77 in ./ATI/lib/python3.12/site-packages (from torch) (12.6.77) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.6.77 in ./ATI/lib/python3.12/site-packages (from torch) (12.6.77) Requirement already satisfied: nvidia-cuda-cupti-cu12==12.6.80 in ./ATI/lib/python3.12/site-packages (from torch) (12.6.80) Requirement already satisfied: nvidia-cudnn-cu12==9.5.1.17 in ./ATI/lib/python3.12/site-packages (from torch) (9.5.1.17) Requirement already satisfied: nvidia-cublas-cu12==12.6.4.1 in ./ATI/lib/python3.12/site-packages (from torch) (12.6.4.1) Requirement already satisfied: nvidia-cufft-cu12==11.3.0.4 in ./ATI/lib/python3.12/site-packages (from torch) (11.3.0.4) Requirement already satisfied: nvidia-curand-cu12==10.3.7.77 in ./ATI/lib/python3.12/site-packages (from torch) (10.3.7.77) Requirement already satisfied: nvidia-cusolver-cu12==11.7.1.2 in ./ATI/lib/python3.12/site-packages (from torch) (11.7.1.2) Requirement already satisfied: nvidia-cusparse-cu12==12.5.4.2 in ./ATI/lib/python3.12/site-packages (from torch) (12.5.4.2) Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in ./ATI/lib/python3.12/site-packages (from torch) (0.6.3) Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in ./ATI/lib/python3.12/site-packages (from torch) (2.26.2) Requirement already satisfied: nvidia-nvtx-cu12==12.6.77 in ./ATI/lib/python3.12/site-packages (from torch) (12.6.77) Requirement already satisfied: nvidia-nvjitlink-cu12==12.6.85 in ./ATI/lib/python3.12/site-packages (from torch) (12.6.85) Requirement already satisfied: nvidia-cufile-cu12==1.11.1.6 in ./ATI/lib/python3.12/site-packages (from torch) (1.11.1.6) Requirement already satisfied: triton==3.3.1 in ./ATI/lib/python3.12/site-packages (from torch) (3.3.1) Requirement already satisfied: mpmath<1.4,>=1.1.0 in ./ATI/lib/python3.12/site-packages (from sympy>=1.13.3->torch) (1.3.0) Requirement already satisfied: MarkupSafe>=2.0 in ./ATI/lib/python3.12/site-packages (from jinja2->torch) (3.0.2) However, when trying to re-install flash_attn, it complains: Collecting flash_attn Using cached flash_attn-2.8.0.post2.tar.gz (7.9 MB) Installing build dependencies ... done Getting requirements to build wheel ... error error: subprocess-exited-with-error × Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> [20 lines of output] Traceback (most recent call last): File "/home/mickey/dev/ATI/ATI/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module> main() File "/home/mickey/dev/ATI/ATI/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main json_out["return_val"] = hook(**hook_input["kwargs"]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/mickey/dev/ATI/ATI/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel return hook(config_settings) ^^^^^^^^^^^^^^^^^^^^^ File "/tmp/pip-build-env-nt9zjl19/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 331, in get_requires_for_build_wheel return self._get_build_requires(config_settings, requirements=[]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/tmp/pip-build-env-nt9zjl19/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 301, in _get_build_requires self.run_setup() File "/tmp/pip-build-env-nt9zjl19/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 512, in run_setup super().run_setup(setup_script=setup_script) File "/tmp/pip-build-env-nt9zjl19/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 317, in run_setup exec(code, locals()) File "<string>", line 22, in <module> ModuleNotFoundError: No module named 'torch' [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error × Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip. How do I fix this? Continue reading...
