I have a use case, where a large remote file needs to be downloaded in parts, by using multiple threads. Each thread must run simultaneously (in parallel), grabbing a specific part of the file. The expectation is to combine the parts into a single (original) file, once all parts were successfully downloaded. Perhaps using the requests library could do the job, but then I am not sure how I would multithread this into a solution that combines the chunks together. url = 'https://url.com/file.iso' headers = {"Range": "bytes=0-1000000"} # first megabyte r = get(url, headers=headers) I was also thinking of using curl where Python would orchestrate the downloads, but I am not sure that's the correct way to go. It just seems to be too complex and swaying away from the vanilla Python solution. Something like this: curl --range 200000000-399999999 -o file.iso.part2 Can someone explain how you'd go about something like this? Or post a code example of something that works in Python 3? I usually find the Python-related answers quite easily, but the solution to this problem seems to be eluding me. Continue reading...
