Find Jobs
Hire Freelancers

Create Scraper for KSL.com Classifieds Using Headless Chrome with Puppeteer in Python 3 -- 2

$30-250 USD

Terminado
Publicado hace casi 5 años

$30-250 USD

Pagado a la entrega
We need a scraper for KSL classifieds ([login to view URL]). The scraper needs to use Puppeteer and Headless Chrome. The scraper needs to be written in Python 3. All requests need to be routed through Crawlera ([login to view URL]) in order to avoid getting banned. We already have a subscription and API keys for this. The scraper needs to accept the following search / filter parameters: keyword min price max price category seller type listing posted timeframe The scraper also needs to be able to run without any search parameters. We already have a Google Cloud Platform Virtual Machine (Google Compute Engine Virtual Machine) Debian instance. This scraper needs to run on it. We already have a MySQL 2nd Gen 5.7 instance running on Google Cloud Platform. The scraper needs to write all results to this database. The scraper needs to store the following attributes about each individual listing in our MySQL database: title location datetime posted price category description number of page views number of favorites listing number The scraper needs to run on a schedule (every 15 minutes, for example). This schedule needs to be modifiable if we want to change it later. We need the code. We will run the spider to scrape all listings and run continuously on our Google Compute Engine instance. The scraper needs to update existing listings in the database when listing properties on [login to view URL] change. Example: a cell phone is posted for $400. The scraper finds the cell phone and stores it in the database. Two days later, the seller changes the price to $350. The scraper sees the ad again, sees that a listing attribute (the price) has changed, and updates the row in the database.
ID del proyecto: 20373155

Información sobre el proyecto

15 propuestas
Proyecto remoto
Activo hace 5 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
Adjudicado a:
Avatar del usuario
Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$174 USD en 3 días
4,9 (142 comentarios)
7,6
7,6
15 freelancers están ofertando un promedio de $203 USD por este trabajo
Avatar del usuario
Hi Nice to meet you. I have enough experience in python script. Below the libraries are I used in past project. selenium, pandas, matplotlib, lxml, beautifulsoup, scipy, and other useful libraries. I have written some automation and scraping, scientific scripts. So I think I can help you in your project. Just let me know if you want start job. Regards. Lian
$200 USD en 7 días
4,9 (118 comentarios)
6,8
6,8
Avatar del usuario
Hello Sir, We are expert in data scrapping We are team of professional developers with having more than 7 year's experience in this field also I read your project description and We are interested in it but still we need some more information Can we discuss the project ? We are waiting your response Thank You Regards Jawad Ahmed
$250 USD en 7 días
4,9 (73 comentarios)
6,4
6,4
Avatar del usuario
Hello How are you i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your posting Xu Han
$140 USD en 7 días
4,9 (59 comentarios)
6,3
6,3
Avatar del usuario
‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less  ,,,,,,,,,,,,. , ,,,,,,,,,
$111 USD en 3 días
4,9 (97 comentarios)
5,8
5,8
Avatar del usuario
Dear Sir, I am interested in your project. I'm expert in web scrapping and web automation using selenium and jsoup, data management, data mining. I assure, I will do my best to work with you on your project to present the best possible outcome for you and your customers. I will also do my best to correct any area of work where quality comes into question, I want to have pride in my service to your company and the final product provided. I look forward to working with you. Thanks & Regards
$200 USD en 4 días
4,8 (43 comentarios)
5,9
5,9
Avatar del usuario
Hello! I am glad to place a bid on your project. I am good at Python and its scraping modules including selenium, scrappy, and so on. I have read your description and I can do your project perfectly. I can do your project in time and I can provide you full service. Looking forward to your reply. Thanks. Regards.
$140 USD en 7 días
5,0 (32 comentarios)
5,4
5,4
Avatar del usuario
Hi, How are you? I am very interest in your project. As I am a professional Python,Scraping Expert with great experience and skills, I am sure that I can help you I'm ready to start to work on your project right now. If we clarify the requirements via chatting, I will provide you with top quality on time. If you trust and award me, so I will finish it rapidly and perfectly. I've always been giving clients satisfaction with the great quality of work, as you can see my profile. Thanks in advance.
$200 USD en 7 días
5,0 (8 comentarios)
4,2
4,2
Avatar del usuario
I am a professional data scientist from Scotland, I am currently working with a financial firm scraping financial data from various sources. I have the relevant experience needed for this project. Lets discuss more when you are available.
$250 USD en 7 días
5,0 (7 comentarios)
4,1
4,1
Avatar del usuario
Hello dear hiring manager With my good experience in core python, I can scrape any website with the help of Scrapy and Selenium. till now I have scraped more than 200 websites which includes Linkedin, Facebook, Twitter, Instagram, google reviews, Yellowpages, playstore, reditt, glassdoor and many more. I am a problem solver and I believe in providing complete solutions. If you have a project in mind and you don't even know where to start, then you've come to the right person. I'm flexible with my working hours and am happy to work closely with any existing freelancers you work with. You can expect prompt, polite and helpful communication from me. I believe communication is the key to any successful project, and I'd like to start things off on the right foot suggesting we schedule a phone or $kype call to discuss the project further. This will enable us to make sure we communicate well and that both parties are completely comfortable with the scope of the project. Please let me know a time that works best for you and I'll make sure that I make myself available. If you give me this opportunity, this would be my first project on Upwork, so I'd be really regretful if you could give me this opportunity Kind regards, Himanshu
$200 USD en 2 días
5,0 (2 comentarios)
2,6
2,6
Avatar del usuario
Hey there, I'm a professional website developer on python frameworks(flask). I can do your web scrapping. For further details, please message me.
$230 USD en 7 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Hello there! My name is Chris, I'm a UK based and native English speaking web developer and app expert with 10 years experience building and maintaining complex web apps and websites. I've built and maintained applications/sites for large companies such as Coca Cola, Deutsche Bank, Easy Jet, Barclays, Vogue, Menzies, NHS, My specialist skills include: PHP, Javascript , MYSQL, Bootstrap, SEO, Digital Marketing, Laravel, IONIC, WooCommerce, Moodle, WordPress, Drupal, New Website Builds, Search Marketing, Graphic Design, NGINX, Apache2. I'm highly motivated, results driven and personable individual with a keen eye for details and getting projects finished in a quick timescale, whilst still delivering a world class customer experience. Chris Fairman
$250 USD en 1 día
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de UNITED STATES
Brigham City, United States
5,0
1
Forma de pago verificada
Miembro desde jul 13, 2019

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.