Is there a way to natively select the last day of each quarter in PySpark? For example, in a df containing two columns - yyyy_mm_dd and sum. How could I return sum for the last day of each quarter? For the current / in progress quarter it would be good to show the max date instead. I looked at this solution Get First Date and Last Date of Current Quarter in Python? and it works, however I was wondering if there is a solution using PySpark syntax rather than a udf? Continue reading...
