[Python] Not able to run a spark code due to some issue on my local

Discussão em 'Python' iniciado por Stack, Julho 19, 2025.

  1. Stack

    Stack Membro Participativo

    I am facing the below error while running the given piece of spark code on my local Pycharm Community Edition and the spark session is not getting created. I have set up all my local environment variable correctly for jdk and spark both. FYI I am using java "openjdk 11.0.22 2024-01-16", "javac 11.0.22", Python 3.13.5 and pyspark 3.5.6 versions. Could someone please help me to solve this issue. Thanks in Advance!!!

    from pyspark.sql import functions as f
    from pyspark.sql import SparkSession
    from pyspark.sql.functions import session_window
    from pyspark.sql import Window
    import os
    import findspark

    findspark.init("C:\\spark")
    os.environ["JAVA_HOME"] = "C:\\Program Files\\Eclipse Adoptium\\jdk-11.0.22.7-hotspot"
    os.environ["SPARK_HOME"] = "C:\\spark"
    print("Pyspark Imported")
    spark = SparkSession.builder.appName("CSVEXAMPLE").getOrCreate()

    print("spark sessions started")
    print("Spark Version:", spark.version)


    The "Pyspark Imported" line is only getting printed then the below error is coming.

    Error:

    File "C:\Users\pythonProject\TEST_SCRIPT.py", line 11, in

    spark = SparkSession.builder.appName("CSVEXAMPLE").getOrCreate()

    File "C:\Users\pythonProject.venv\Lib\site-packages\pyspark\sql\session.py", line 559, in getOrCreate

    session = SparkSession(sc, options=self._options)

    File "C:\Users\pythonProject.venv\Lib\site-packages\pyspark\sql\session.py", line 635, in init

    jSparkSessionClass.getDefaultSession().isDefined() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^

    TypeError: 'JavaPackage' object is not callable

    Process finished with exit code 1

    Continue reading...

Compartilhe esta Página