[Python] compare elements in nested array, and then count how many match and how many pairs in...

PySpark gurus, I need your help.

I have dataframe with column as nested array, like [[A, A], [A,B], [C,D]], I need your help to find out there are three pairs in total, two pairs not match ([A,B], [C,D], one pair match [A,A].

Please use PySpark. Thank you for your help

Continue reading...