[Python] How to get the KL divergence between two datasets (say ImageNet1k and FGVC-Aircraft)

I want to find out the KL divergence between 2 datasets, so for that I am extracting the features from ResNet50 for both of them, but if I calculate the same for ImageNet1k (say 20% of val set) and FGVC-Aircraft test set, I get a very high score for KL divergence something more then 50k. I am currently using this code - https://gist.github.com/ChuaCheowHuan/18977a3e77c0655d945e8af60633e4df

Continue reading...