I currently use [login to view URL] as my proxy , and I am scrapping about 100,000 Instagram accounts per day. These are rotating changing proxy on every request.
Attached my program in the works and the parameters I am filtering the proxies with. This system is generating me around 100,000 requests per day
I am looking for a proxy solution that can help me scale to 1,000,000 per day to even 10,000,000. My issue here is scaling.
In your entry, please explain your experience with bulk scrapping and your proxy solution / Instagram experience if you have any.
Thanks!