Find Jobs
Hire Freelancers

DATA-SCRAPING SEARCH ENGINE - data scraping expert needed

$250-750 USD

En curso
Publicado hace casi 10 años

$250-750 USD

Pagado a la entrega
This is my website: [login to view URL] which was build by a freelancer.com member who has since been BANNED for being a scammer. [login to view URL] is a SEARCH ENGINE which scrapes data from a list of 150-200 websites selling watches. I need a data scraping expert to complete the search engine - which scrapes data from over 150-200 websites. These things are incomplete: a. DATA is not fetched from all 150-200 websites b. existing websites scraped is not consistently fetched data c. email alert function is not working d. email alert function admin panel to approve signups e. social media interface incomplete These are the comments from a data-scraping expert, which u need to fix: " Current setup is not flexible, we have to add a scrapping script for each of the URL we need to scrap for data, even if they are similar and just a pagination of the same website. So 2 scrips for [login to view URL] and [login to view URL] This needs to improve so it can autoscrap the other pages of the same URL, even if they do not exist now but will be added later There are about 35 files suppose to be executed to scrap all of the URL you have in the list. Have not confirmed if they have covered all of the URL as need to match them in each of the file. It is difficult to execute all of these 35 files manually and/or as cron jobs. It should be just one process which should scrap all of the pages. Database details are being defined in each of these files, and need to be updated in each of them in case later on you decide to change the password or want to setup on different host. Tiring :) Current setup is not suitable to run as cron jobs, as they are scrapping over 20 web pages within the single script, failure of one of them, will result failure of all. Current setup of scrapping is very slow, as it is done sequentially. So the next webpage can only be scrapped once the previous one completes successfully. Not all of the scrapping scripts are complete, as I can see for some Web URL they have incomplete codes inside. This means you are currently not getting the data from these web pages. For ex. [login to view URL] Jobs are being executed manually on browser, with a fixed page refresh limit. This is causing the pages to reload after the specified time and start from the start again. Due to that, the pages schedule to be scrapped down the page might not be executed in case the one above take longer then the reload time." If you wish to be hired, you must a. PROVE THAT you can make this website 100% functional b. SPEAK GOOD ENGLISH and can LISTEN well c ANTICIPATE client needs well. DO NOT only WAIT TO BE TOLD. d. be PROFESSIONAL and do what is needed to get the search engine up and running e. advise what hosting requirements are needed. this is the current plan: VPS 1180 [login to view URL] f. you must be the TECHNICAL PERSON - I DO NOT wish to speak to the BUSINESS DEVELOPMENT PERSON. g. Advise how FUTURE WEBSITES can be uploaded and data fetched from them. Thank you.
ID del proyecto: 6279553

Información sobre el proyecto

19 propuestas
Proyecto remoto
Activo hace 10 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
Adjudicado a:
Avatar del usuario
Hi Shing, I am Sandeep. We spoke about your website on Skype. We have checked your requirements and we will surely be able to complete these tasks for you. We have done some research prior to sending this proposal to you. We have done similar project which you checked already. We can help you fetch data from all the websites unless there is a restriction. We will consult you on page load speed too. About consistency in html we have checked it at our end. We need to know how you wish to place things. It will need some evaluation. If you are taking data from 200 odd sites it may reduce speed and we therefore need to manage it well. Let me know your thoughts. We are keen to start.
$421 USD en 21 días
5,0 (2 comentarios)
3,6
3,6
19 freelancers están ofertando un promedio de $736 USD por este trabajo
Avatar del usuario
Hi I have gone through the details of your project and we find it well within our capabilities. I offer a wide range of services, including Web design, PHP/MySQL web application development, Open sources like Joomla, Os-commerce, Zen cart-Drupal I can create and deliver the project as per the information.I have skilled, expert programmers I'm very excited to assist you in making your Sites successful – please feel free to contact me directly to discuss this position further. Thanks
$670 USD en 20 días
4,8 (270 comentarios)
7,4
7,4
Avatar del usuario
Hello, First of all, I am available for your project to start immediately. I am good in data scraping form other web pages. I can complete this task within 20 days for sure. I have experience of developing huge sites. Please message me if you wish to see my past work. I can give you great online store done. I will also available to you after completion of project for technical help/support. we can discuss price/time further here on chat. Here are some reasons to select my programming service. 1. I have 100% project completion rate, please read my reviews. 2. I have experience of developing huge and successful projects 3. I have strong team of web developers (size of 12 programmers) 4. I will give you daily work updates and you can see the development progress on my server regularly 5. I have experience of working with overseas clients from USA, SA, UK, Nederland, Australia. I am looking forward to work with you. thank you.
$833 USD en 20 días
4,8 (89 comentarios)
7,3
7,3
Avatar del usuario
I am an expert in delivering custom scripts and willing to discuss further about the project details/
$736 USD en 10 días
4,8 (102 comentarios)
7,1
7,1
Avatar del usuario
Hi, I have done a similar assignment before and would anticipate this would take me around 8 hours to complete. Im an EXPERT in scraping. Please send me a message if interested. Thank you.
$736 USD en 0 día
4,9 (39 comentarios)
6,3
6,3
Avatar del usuario
Hi, Thanks for alerting me for this project. We can handle it. Don't be worried. If you need more clarifications. Please be online on the Skype and let us have a chat too. we are also looking for more jobs from you. please keep on doing us your favor. Thanks & Regards
$631 USD en 20 días
4,9 (15 comentarios)
6,1
6,1
Avatar del usuario
Hello i have done a very similar project for another satisfied client which can be recalled here https://www.freelancer.com/projects/PHP-Javascript/Mid-sized-poker-portal-Javascript.4787356.html. The project was similar to this one with the changes that data type was xml instead of html and instead of watches the project was scrapping poker tournaments. The system we decide was a GUI solution on which with no code changes you can integrate any url which provides XML, and with drag and drop configuration configure the url for data, once configured you can set a duration to refresh data and the system automatically pulls data and removes duplicates and all stuff. Everything is done in GUI and no code changes for new feeds, and u also get alerts if a url data format(HTML in our case) changes so that scrapping cannot proceed without reconfiguration. The budget is higher than what you posted, but this solution would be a clean high level for u once done you wont have to work on it to add new links. If you are interested i can demo old system and discuss how we can proceed as well as provide you more technical information. Thanks and Regards, Jiby Jose
$2.222 USD en 20 días
4,9 (7 comentarios)
5,4
5,4
Avatar del usuario
Hi, I (Myself a senior PHP, ASP.NET programmer using C# and VB) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bug-free codes at the very first instance. After seeing our quality of work and the cooperation offered to you even after the work has been delivered to you, you’ll come to us again and again to avail our services. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I can achieve the results that you are asking for within your timeframe and budget. I am confident I can exceed your expectations and I would love to work on your project. Thanks, Priyanka
$789 USD en 20 días
5,0 (14 comentarios)
5,1
5,1
Avatar del usuario
I've expertise in web-scraping as my regular expression skills is quite high especially when working with PHP, i can do all the task with preg_match or preg_match_all to fetch all necessary data.
$500 USD en 10 días
4,9 (4 comentarios)
2,4
2,4
Avatar del usuario
A proposal has not yet been provided
$500 USD en 10 días
5,0 (3 comentarios)
1,9
1,9
Avatar del usuario
Hello, I am a new programmer here. I need some job examples, so it is the best I can offer - cheap price and nice quality. Waiting for your approvement and can't stand to start the job! I have an experience in data scrapping, can understand what you are looking for. I have also experience in VPS management and can handle all the stuff. If you want quality - message me up and approve :)
$488 USD en 5 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Hi, Thanks for your interests. Well, I will try my best to do the website functional as much as possible, hope to do 100%. I am able to do maximum automation via programming. I have good English spoken and listen ability. I am the technical person. Let me know, to move on your project. Regards! JS
$720 USD en 15 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de HONG KONG
Hong Kong, Hong Kong
5,0
4
Forma de pago verificada
Miembro desde jun 2, 2014

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.