[Python] convert dictionary keys to columns and dictionary values to column values

I would appreciate if someone could help me the below task.

I am working with pyspark and stuck with some column transformations.

I am trying to convert the below table

Data type of column Factors : array<structkey:string,value:string>



to



Thank you for your help

Continue reading...