In order to collect data from the site (about 120000 objects), I made a parser in Colab Google, but forgot about time delay between requests. When I first tried to run parser on 9000 objects, 500 error occurred. Then after some changes I managed to parse 18000 objects, but now 429 error occured and there is no information like "try after..." Should I give up or how to calculate how much longer will the site be blocked for parsing? Because after 6 hours not even 1 request is processed. Continue reading...
