Find Jobs
Hire Freelancers

simple web scrap project

$30-250 USD

Cerrado
Publicado hace más de 8 años

$30-250 USD

Pagado a la entrega
project for web pages scrap requirements: the application required should: when the app starts, it should open a window for user to select (connection string to sql server database , table and field for the starting urls, number of threads, sql table/fields for the results extracted and the search engine to be used) also app should allow user to save above settings for future use (if possible , if not then the applicatoin at least keep the last updated user settings) when app starts extractions it should: 1-the app should start to read the number of threads from the source sqlerver table together with their respective ids into an array ,from sql server source table, "2-effect search in hidden mode on a special browser called 'tor browser' using one of the browser search engines called duckduckgo or disconnect" "3-extract the search results back into sqlserver 'results table' by filling following fields in sql table using regular expression to extract following fields from the search results: -id of the original searched url -the entire search result page as nvarchar(max) type -the individual search result (result page may contain 0 to 30 search results) as nvarchar(max) type -the url found in the search result as nvarchar(max) type -the companyname if found as nvarchar(255) type -the contact name if found as nvarchar(255) type -the website if found as nvarchar(255) type -the telephone if found as nvarchar(255) type -the fax if found as nvarchar(255) type -the mobile phone if found as nvarchar(255) type -the email address if found as nvarchar(255) type -the website address if found as nvarchar(255) type note if more than one email is found within the search result then app should creat counter number of sql server rows in the table having all above fields and each one of the emails found per row note the output sql table with all these fields would have being already created by the user and the app should fill the data into the proper fields" "after finish the threads, the app should flag the records in the original table "finished"" "and then continue to process the next threads/records from the source sql server table example of urls to be searched like "[login to view URL] for example ." note2: may be the app will need to refresh tor browser every 2-3 runing of threads so that to avoid captcha, and to refresh tor, it is manually like clicking the green onion on the top left hand side on the bar and select new identity" note3: the app should determine that the search pages were fully loaded before extracting data important factors: 1- the speed should be to maximum (target to achieve minimum of 3 searches per second) 2-the app will be ran on several different machiens and all rning versions will be accessing the same sql server data base/table hence each app versionshould flag the starting records it read as 'used' to avoid other running version to take same records
ID del proyecto: 8927291

Información sobre el proyecto

9 propuestas
Proyecto remoto
Activo hace 8 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
9 freelancers están ofertando un promedio de $196 USD por este trabajo
Avatar del usuario
A proposal has not yet been provided
$250 USD en 3 días
4,6 (53 comentarios)
5,5
5,5
Avatar del usuario
Dear Sir, It’s a great pleasure me to bid on your project. I am a 7 years experienced web Developer.. I hold a master degree for Computer Science. Please see my profile, I have enough experiences and gained lot of job experiences working in various world recognized institutions. I am maintaining 100% on time job completion rate with 5 star rating in freelancer.com customer reviews. And also I have passed the necessary skill examinations in freelancer.com which are related to complete your project. As a master for Computer Science I can handle your project to meet your requirements which are listed in the project description. I will start your project for a minimum initial payment and balance you can pay at the end of each milestone or you can create milestones at your convenience according to satisfaction of my work. Further I will give you 3 months free of charge bugs fixing and maintenance service to improve your application’s performance. I will let you to see progress of your project by hosting your application on my live testing server. Please accept my bid if u are satisfy with my proposal. Thank you for giving opportunity to bid on your project…!
$155 USD en 3 días
4,9 (20 comentarios)
4,4
4,4
Avatar del usuario
Hi I have 15+ years experience in web scraping and data entry .so i can do easily. Please send me a more details so i can start your project ASAP. Thanks
$68 USD en 3 días
4,7 (16 comentarios)
4,5
4,5
Avatar del usuario
A proposal has not yet been provided
$250 USD en 5 días
4,9 (11 comentarios)
3,7
3,7
Avatar del usuario
hello, I will make this scraper for you in just 3 days max. I will make sure you get the maximum speed with maximum efficiency. so please contact me. so that we can make a great deal. regards, mantu
$120 USD en 3 días
4,9 (9 comentarios)
3,6
3,6
Avatar del usuario
A proposal has not yet been provided
$30 USD en 1 día
4,0 (6 comentarios)
2,9
2,9
Avatar del usuario
Hello, My name is Dmytro Bibik, I am a PM of an outsourcing software and web development company “DB Devs” from Kharkiv, Ukraine. Your task seems to be utmost coincident with our focus of expertise. We can build a scraping solution to harvest and handle all the information you need basing on our pre-existing time-tested scraping application - the Crawler, that will be thoroughly customized to your requirements. Please, do not be confused with our beginners’ rating here. We only started with freelancer.com marketplace, but the Crawler is the product of our more than 8 years experience on IT market within a wide range of database related services. We have created a huge number of scraping solutions for sports websites, retail websites, email and marketing websites, real estate websites, etc. Used technologies: .NET (C#), MS SQL database. It makes possible to deliver a very reliable and efficient scraping application. As a result, we provide a powerful tool to scrape data from websites of any levels of complexity, having captcha, javascript, blocking IP addresses, etc. The presented price in the bid is very rough and negotiable. Please, let me know about your interest, and I will immediately provide you with detailed estimation of project scope, costs and duration as well with demo of the Crawler. I hope to hear from you soon and look forward to collaborate with you. Best regards, Dmytro Bibik Project Manager DB Devs
$222 USD en 3 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
A proposal has not yet been provided
$30 USD en 1 día
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de EGYPT
Egypt
0,0
0
Forma de pago verificada
Miembro desde nov 8, 2015

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.