Need to scrape 1 million plus products on Aliexpress.
My current semi automated process is as follows:
- open google chrome
- login to wordpress
- navigate to alidropship section on wordpress
- click on "direct import" button
- "Direct import" button opens up aliexpress
- i navigate to a certain category within aliexpress
- A plugin called "Alidropship" is a plugin used in chrome to import products from aliexpress into my website
- when i navigate to the category of my choice, i run a macro recorder that opens 50+ product tabs in chrome
- macro recorder goes to each tab and click "import" button for the alidropship plugin to start scraping product pictures and info on that page
- once 50 products are imported, macro recorder closes all the tabs and goes to next page and repeats the process.
- Macro recorder can only scrape 50 products every 4-5 mins if the macro recorder goes to fast importing the items, aliexpress displays a captcha
I need an application that can run in the background 24 hours a day/ 7 days a week without interruption. Currently i import products for a few hours. Over 2 weeks i have imported 25k products. At this rate i will complete my project in 100-150 days which is too long. I need an application that runs in the background because the current macro takes over my mouse limiting me from using my pc to do other work. I have all the proper tools to import the products into my website, i just need the application to run quitely in the background. There are limitations being that i can only import 50 products every 4-5 mins from aliexpress to avoid captchas. Hopefully this project has been well described. Contact me for more info and videos about the project as you need a general understanding of what i need before you start.
8 freelancers están ofertando el promedio de $142 para este trabajo
hello hope you are doing well I am interested to work on this project. Gladly waiting to serve you with my extensive 8+ years skills. Can we discuss about Aliexpress API if they give or php scrapping