We need a PHP or Python script that runs on a linux server.
- Script will poll the main page of a web site, get sub-page links from it and then scrape those sub-pages for data
- Script that parses the sub-pages should be able to run asynchronously and concurrently with other instances of itself.
- Upon parsing data, it will be added to a MySQL database.
Script should be able to run over multiple VPN connections as an option.
Hello Sir, I am skilled in data scraping job and has recently scraped about 5 airline websites for ticket rates etc and couple of them had ajax forms. An important point in your project is the script being "asynchronous" and I have done that before in 2 ways. Please check your Inbox for details. Regards, //Shahriyar