[Python] "The system cannot find the path...

I set up spark in my windows system. Post this, I could run pyspark command in command line which worked perfectly 2 days back. But, now surprisingly I get this error:



Below are the environment variables

• 
  HADOOP_HOME = C:\Program Files\hadoop-3.3.6
  
  
• 
  JAVA_HOME = C:\Program Files\Java\jdk-11.0.0.2
  
  
• 
  PYSPARK_DRIVER_PYTHON = C:\Users\Gagana H\AppData\Local\Programs\Python\Python313\python.exe
  
  
• 
  PYSPARK_PYTHON = C:\Users\Gagana H\AppData\Local\Programs\Python\Python313\python.exe
  
  
• 
  PYTHONPATH = C:\Program Files\spark-3.5.5\python and C:\Program Files\spark-3.5.5\python
  
  
• 
  SPARK_HOME = C:\Program Files\spark-3.5.5
  
  
• 
  PATH:
  
  
  

Based on few suggestions in stackoverflow I did see if there is python executable file in AppData folder - and it is indeed present. Unable to figure out the issue as to how it stopped working.

Note: The only thing I did after setting up JDK, Hadoop, Python and Spark is that I installed pycharm. Does this cause any issue?

Continue reading...