[Python] How to install Python libraries in Azure Synapse Notebook Spark Cluster (pyspark)

Discussão em 'Python' iniciado por Stack, Fevereiro 10, 2025.

  1. Stack

    Stack Membro Participativo

    I am facing a problem with Python libraries installation in Azure Synapse Notebook. I have tried installing two libraries, holidays and fugue using %pip... and !pip... I have tried even with .WHL files, but nothing is working. Cluster have not any restriction. The error is:

    WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f29776c5240>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/fugue/
    WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f29776c4ca0>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/fugue/
    WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f29776c47c0>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/fugue/
    WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f29776c7250>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/fugue/
    WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f29776c4130>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/fugue/
    ERROR: Could not find a version that satisfies the requirement fugue (from versions: none)
    ERROR: No matching distribution found for fugue
    Note: you may need to restart the kernel to use updated packages.
    Warning: PySpark kernel has been restarted to use updated packages.


    Any thoughts about what is wrong?

    I have tried %pip install fugue, and !pip install fugue, .whl files.

    Continue reading...

Compartilhe esta Página