Hello sir,
I have read the requirements. I am well versed with crawling whole sites using Sitemaps, Country/Language selectors. I like to craft scalable and stealthy spiders.
Other than that, I have maintained a web crawler that have scrapped 10 million records for a single semiconductor marketplace. I have crawled more than 60 e-commence domains using Scrapy. If sites are ajax rendered, I like to simulate XHR requests whenever possible. I have experience with web scrapping using Scrapy, Scrapy-Splash, BeautifulSoup, and NodeJS for one and a half year.
I am akin to tackle and work on challenging problems. I have exposure with task management tools like Jira and versioning tools such as git/bitbucket. let me know if you want to take a look at code I write.
You could go through my profile for details on services offered by me.
I would like to work on your problem. Kindly feel free to chat.
Thanks for reading