[Python] Upload a large file to Minio from Minio objects

I have the next case:

Get a certain count of N objects from Minio and create zip archive and upload it zip to Minio as one object.


Problem:

1. I have many objects, that are up to 40gb in size
2. I can't load all objects bytes in memory - server memory size is 4gb
3. The server hard drive size is 240gb

I use miniopy-async for work with Minio.

May be have any ideas?

Continue reading...