Im using pyspark to turn my data into a spark dataframe. This is a test code cus my original code is pretty long; but basically it takes in an excel, cleans it then puts it in a function to turn it into spark dataframe. i keep getting the OS error and that my python worker has crashed. Please if anyone has encountered this error, please help i have been stuck here for a while and its frustrating :/ (https://i.sstatic.net/7AIBbDeK.png)](https://i.sstatic.net/AJNr2cC8.png) Ive installed python 3.9,3.8 and 3.7 to see if its more compatible with pyspark but im getting the same error. Whats actually causing my python worker to crash? Continue reading...
