[Python] I am stuck trying to install flash attention (flash-attn)

I am trying to install flash attention with pip install flash-attn --no-build-isolation (I am actually trying to get MeshAnythingV2 running and this is one of many tedious steps) I have installed miniconda, switched to python 3.10, installed dependencies like packaging, wheel, torch, installed correct version of CUDA, have set PATH to nvcc and CUDA_HOME (which is especially annoying cuz this is the exact thing I am being told to do here), but still, it refuses to run and I am back to the start when I was getting nearly this exact error. Any help, please?

Using cached flash_attn-2.7.2.post1.tar.gz (3.1 MB)
ERROR: Command errored out with exit status 1:
command: 'C:\Users\user\AppData\Local\Programs\Python\Python310\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\user\\AppData\\Local\\Temp\\pip-install-dimka3nm\\flash-attn_baac6578ebc84aadbb5bf54982c89834\\setup.py'"'"'; __file__='"'"'C:\\Users\\user\\AppData\\Local\\Temp\\pip-install-dimka3nm\\flash-attn_baac6578ebc84aadbb5bf54982c89834\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\user\AppData\Local\Temp\pip-pip-egg-info-t7c36ter'
cwd: C:\Users\user\AppData\Local\Temp\pip-install-dimka3nm\flash-attn_baac6578ebc84aadbb5bf54982c89834\
Complete output (19 lines):
fatal: not a git repository (or any of the parent directories): .git
C:\Users\user\AppData\Local\Temp\pip-install-dimka3nm\flash-attn_baac6578ebc84aadbb5bf54982c89834\setup.py:99: UserWarning: flash_attn was requested, but nvcc was not found. Are you sure your environment has nvcc available? If you're installing within a container from https://hub.docker.com/r/pytorch/pytorch, only images whose names contain 'devel' will provide nvcc.
warnings.warn(
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\user\AppData\Local\Temp\pip-install-dimka3nm\flash-attn_baac6578ebc84aadbb5bf54982c89834\setup.py", line 177, in <module>
CUDAExtension(
File "C:\Users\user\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\utils\cpp_extension.py", line 1279, in CUDAExtension
library_dirs += library_paths(device_type="cuda")
File "C:\Users\user\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\utils\cpp_extension.py", line 1497, in library_paths
paths.append(_join_cuda_home(lib_dir))
File "C:\Users\user\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\utils\cpp_extension.py", line 2889, in _join_cuda_home
raise OSError('CUDA_HOME environment variable is not set. '
OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root.


torch.__version__ = 2.7.0+cpu


----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/83/29/48df18cb51902a7cb7a0ee13327bb2cf50b6ba24bd2e8283d0a9538dde52/flash_attn-2.7.2.post1.tar.gz#sha256=574897afeb6cbd63e78a612dded95491efe4a46818245cf1a5ace7357d993faa (from https://pypi.org/simple/flash-attn/) (requires-python:>=3.9). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.


Path and other variables like CUDA_HOME and their values

Continue reading...