In Pyspark, How to find dataframe size through any available methods in Pyspark.? My Production system is running on < 3.0 spark version. The idea is based on dataframe size i need to calculate shuffle partition number. Continue reading...
