[Python] Why is python using 3.8.1 and 3.9, then fail to install packages (ERROR: Package pkg...

I was trying to test the installation of my ultimate-utils library and I get this bizzare error:

(meta_learning) brandomiranda~/ultimate-utils ❯ pip install -e .
Obtaining file:///Users/brandomiranda/ultimate-utils
Preparing metadata (setup.py) ... done
Collecting dill
Using cached dill-0.3.4-py2.py3-none-any.whl (86 kB)
Collecting networkx>=2.5
Using cached networkx-2.6.3-py3-none-any.whl (1.9 MB)
Requirement already satisfied: scipy in /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages (from ultimate-utils==0.5.3) (1.7.3)
Collecting scikit-learn
Using cached scikit_learn-1.0.1-cp38-cp38-macosx_10_13_x86_64.whl (7.9 MB)
Collecting lark-parser
Using cached lark_parser-0.12.0-py2.py3-none-any.whl (103 kB)
Collecting torchtext==0.10.1
Using cached torchtext-0.10.1-cp38-cp38-macosx_10_9_x86_64.whl (1.6 MB)
Collecting tensorboard
Using cached tensorboard-2.7.0-py3-none-any.whl (5.8 MB)
Collecting pandas
Using cached pandas-1.3.4-cp38-cp38-macosx_10_9_x86_64.whl (11.4 MB)
Collecting progressbar2
Using cached progressbar2-3.55.0-py2.py3-none-any.whl (26 kB)
Collecting transformers
Using cached transformers-4.13.0-py3-none-any.whl (3.3 MB)
Requirement already satisfied: requests in /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages (from ultimate-utils==0.5.3) (2.26.0)
Collecting aiohttp
Using cached aiohttp-3.8.1-cp38-cp38-macosx_10_9_x86_64.whl (574 kB)
Requirement already satisfied: numpy in /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages (from ultimate-utils==0.5.3) (1.21.4)
Collecting plotly
Using cached plotly-5.4.0-py2.py3-none-any.whl (25.3 MB)
Collecting wandb
Using cached wandb-0.12.7-py2.py3-none-any.whl (1.7 MB)
Collecting matplotlib
Using cached matplotlib-3.5.0-cp38-cp38-macosx_10_9_x86_64.whl (7.3 MB)
Requirement already satisfied: torch<1.10.0,>=1.4.0 in /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages (from ultimate-utils==0.5.3) (1.9.1)
Requirement already satisfied: torchvision<0.11.0,>=0.5.0 in /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages (from ultimate-utils==0.5.3) (0.10.1)
Requirement already satisfied: torchaudio<0.10.0,>=0.9.1 in /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages (from ultimate-utils==0.5.3) (0.9.1)
ERROR: Package 'ultimate-utils' requires a different Python: 3.8.1 not in '>=3.9.0'


however, if you check the dependencies seem to have installed correctly - so I am puzzled what this message means.

In addition if you read the message more carefully you also see that it references 3.8 for some reason (python 3.8? not sure), see:

Requirement already satisfied: torch<1.10.0,>=1.4.0 in /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages (from ultimate-utils==0.5.3) (1.9.1)
Requirement already satisfied: torchvision<0.11.0,>=0.5.0 in /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages (from ultimate-utils==0.5.3) (0.10.1)
Requirement already satisfied: torchaudio<0.10.0,>=0.9.1 in /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages (from ultimate-utils==0.5.3) (0.9.1)
ERROR: Package 'ultimate-utils' requires a different Python: 3.8.1 not in '>=3.9.0'


but if I ask for pythons version its the one I expected 3.9:

(meta_learning) brandomiranda~/ultimate-utils ❯ python
Python 3.9.7 (default, Sep 16 2021, 08:50:36)
[Clang 10.0.0 ] :: Anaconda, Inc. on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>>


So I am very puzzled what is going on. I wonder if pycharm has anything to do with this. But why is it saying it did not install my uutils library?

and checking the pip list confirms its not there:

(meta_learning) brandomiranda~/ultimate-utils ❯ pip list
Package Version
---------------------- ---------
argcomplete 1.12.3
astroid 2.3.3
boto 2.49.0
certifi 2021.10.8
cffi 1.15.0
charset-normalizer 2.0.9
cloudpickle 2.0.0
crcmod 1.7
cryptography 36.0.0
fasteners 0.16.3
gcs-oauth2-boto-plugin 3.0
google-apitools 0.5.32
google-reauth 0.1.1
gsutil 5.5
gym 0.21.0
httplib2 0.20.2
idna 3.3
isort 4.3.21
lazy-object-proxy 1.4.3
learn2learn 0.1.6
mccabe 0.6.1
monotonic 1.6
nodejs 0.1.1
numpy 1.21.4
oauth2client 4.1.3
optional-django 0.1.0
Pillow 8.4.0
pip 21.3.1
pyasn1 0.4.8
pyasn1-modules 0.2.8
pycparser 2.21
pylint 2.4.4
pyOpenSSL 21.0.0
pyparsing 3.0.6
pyu2f 0.1.5
qpth 0.0.15
requests 2.26.0
retry-decorator 1.1.1
rsa 4.7.2
scipy 1.7.3
setuptools 41.2.0
six 1.14.0
torch 1.9.1
torchaudio 0.9.1
torchvision 0.10.1
tqdm 4.62.3
typing_extensions 4.0.1
urllib3 1.26.7
wrapt 1.11.2


running an import from uutils confirms it was not installed:

(meta_learning) brandomiranda~/ultimate-utils ❯ python -c "import uutils; uutils.hello()"
python -c "import uutils; uutils.torch_uu.hello()"
Traceback (most recent call last):
File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'uutils'
Traceback (most recent call last):
File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'uutils'


what is bizzare is that this has worked before in python 3.9. So something changed and I can't figure out what.


it must be a python path issue since now it's opening 2.7 after deleting python 3.8 (which I never installed...). I think conda init is not initiating my shell correctly. Where is:

# >>> conda initialize >>>
# !! Contents within this block are managed by 'conda init' !!
__conda_setup="$('/Users/brandomiranda/miniconda3/bin/conda' 'shell.zsh' 'hook' 2> /dev/null)"
if [ $? -eq 0 ]; then
eval "$__conda_setup"
else
if [ -f "/Users/brandomiranda/miniconda3/etc/profile.d/conda.sh" ]; then
. "/Users/brandomiranda/miniconda3/etc/profile.d/conda.sh"
else
export PATH="/Users/brandomiranda/miniconda3/bin:$PATH"
fi
fi
unset __conda_setup
# <<< conda initialize <<<


suppose to go in the .zshrc file?


refs/related links:

• Can't install new packages for Python (Python 3.9.0, Windows 10)
• Why does Pip claim that a version of Python is not in a given range?
• How does one install PyTorch and related tools from within the setup.py install_requires list?
• https://github.com/brando90/ultimate-utils
• Python OSX $ which Python gives /Library/Frameworks/Python.framework/Versions/2.7/bin/python
• Why is conda init updating my .bash_profile incorrectly?
• How to uninstall Anaconda completely from macOS
• https://superuser.com/questions/121870/how-do-i-reset-the-path-variable-on-mac-os-x
• https://github.com/brando90/.dotfiles/blob/master/README.md

Continue reading...