I have this python script reading multiple binary files, reshaping them, stocking them as arrays in a dictionary. The dictionary is then called elsewhere in the code to apply operations and plot the data, i need to note that the data is time and space dependent, so they need to be read in order. However, when working with large data or when running multiple scripts at once, i run out of RAM and the process gets killed. I looked online and people were suggesting to either map it or read by chunks. I find these to not be a solution to my problem as printing is not an option and chunking will cause problems in my data order. Do you have any other suggestions that applies to my specific case ? Please tell me if you need any additional info or my full script. Thank you for reading me ! Continue reading...
