Develope four crawlers, running on a daily schedul and export data to Excel file

€12-18 EUR / hour

Terminado

Publicado

hace más de 5 años

€12-18 EUR / hour

Project description: Requried is the development of four crawlers to get data from four websites. From those websites all postings of forklift trucks are supposed to be extracted. The crawlers are re-run on a daily basis and collect all new postings. The output than has to be safed to an excel file. New data from the daily crawls has to be either delivered in a new excel file or directly added to the exisiting excel data base. Required skills: - Python, GO, PHP or JVA - Experience in building webcrawlers - Experience in setting up hosting e.g. AWS or similar Websites: - [login to view URL] - [login to view URL] - [login to view URL] - [login to view URL] Required data points: Brand Type of forklift Modell type Year of Manufacturing Operation hours Mast type Lifting capcity Lifting height Engine type (e.g. Diesel, LPG, Battery, etc) Dealer location: Country, postal code, City Scope: Intilially there is expected to be about 150.000 postings. (Optional) Delete duplicates: If possible duplicates are supposed to be deleted before creating the excel file. Some dealers post their inventory on several websites and to make sure those are not accounted for twice the resulting duplicates have to be delelted. Based on the data points it should be possible to create a unique hash-value. (This can be discussed)

ID del proyecto: 18213159

Información sobre el proyecto

9 propuestas

Proyecto remoto

Activo hace 5 años

¿Buscas ganar dinero?

Dirección de email

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto

Cobra por tu trabajo

Describe tu propuesta

Es gratis registrarse y presentar ofertas en los trabajos

Adjudicado a:

@hakyoshyt

Hello, I am an experienced python developer with 2+ years developing scrapers and websites. I have built web scrapers using scrapy, bs4, requests, random proxy, rotating user agent, postgreSQL and lxml. I can provide you with a link to my github account [login to view URL] so you can see some sample projects I have created. A little bit about me I’m an American located in sunny south florida, english is my first and only language and in the past I worked for large companies such as Visa and American Express.

€18 EUR en 40 días

5,0

(1 comentario)

3,5

9 freelancers están ofertando un promedio de €17 EUR /hora por este trabajo

@bestit4u

Hi. I am very interested in your project, because I have much experience in such projects. I have good skills with the program language including C/C++, C#, java, php, asp.net, python, VB.NET. So I have expert and smart technic with web scraping (1000 over projects for scraping), automation and bot(500 over projects for automation and bot), selenium, mobile (android, ios native and others). Especially, I am an expert in betting project and gambling games and sites(bet365, bwin, pinnacle, betfair...) ,,, shopping auto buyer(adidas, footlocker, eastbay, supreme and etc) So, I can solve the captcha automatically. Please contact me, then we can discuss about the details and the price. And I am free in recent days, so I can do my best for your project. Thanks.

€22 EUR en 40 días

4,9

(114 comentarios)

7,1

@dvcontact

Hi Do you want to see a sample of your project on building four web-crawlers that will scrape data from four different website on a daily basis and save the scraped data in Excel file completed before you award the project. You can consider it professionally done in less than 24 hrs. I can tell you about how highly experienced and multi-talented I am. But I’m sure you need more than that. In less than 24 hrs, I will complete a sample part of the job before you award the project so you can be sure you’ve entrusted your job in the best hands. No commitments required! Hope to hear from you soon

€15 EUR en 40 días

4,9

(58 comentarios)

6,5

@hunmin888

Hi, sir! I have a close look to your project. I have a good skill in scrapping. If you want, I can show my previous projects to you. I wish you will work with me for this project. If you award this project to me, we'll complete it in time. Our budget may be negotiable Thanks

€16 EUR en 40 días

5,0

(25 comentarios)

5,7

@vhsoftwareBA

Hello. I can do the crawling software for You. Would base it on python. Scheduler would be created to run the script every morning. Contact me please so we could discuss details. Hope to hear from You. Regards

€15 EUR en 40 días

5,0

(4 comentarios)

4,2

@arcsoft16

"Hi, Hope you are doing well! Thanks for sharing your project requirement with us. It will be our great pleasure to work on your project. I have checked your requirement, yes we can do it, because we already work on similar requirement in past. We have right skills to work on this assignment. . We will complete the work as per requirement Also my team working on same project" We have read out every thing about your project kindly confirm"

€16 EUR en 40 días

0,0

(1 comentario)

0,0

@uday2405

If you're looking for top-quality project delivery that will increase leads, make life easier and build on your brand identity, you've come to the right place.

€16 EUR en 40 días