Find Jobs
Hire Freelancers

Develop a Automatic data scraping solution (via an API) and a browser extension

$250-750 USD

Cancelado
Publicado hace más de 3 años

$250-750 USD

Pagado a la entrega
SUMMARY ************ 1. Automated solution for scraping data from 25 websites 2. Creating an browser extension using the data 3. Providing data insight with use of basic business intelligence tool DETAIL ****** Help develop a proof of concept for a technology solution: • Scraping a large amount of data multiple times (minimum 6) every 24hrs from 25 websites • Comparing the scraped data for changes and showing it in a meaningful way via a browser extension by updating the website in question (think propertylog extensions on chrome) • Linking information to browser extension (over Chrome, Firefox, android browser [Yandex and Kiwi] and IOS Browser Safari) The data will need to be linked to a website and be made available. This is PART 2 of the project and will be posted as a separate project. A good reference example could be these two extensions combined and how they track data, update websites in questions. I recommended that you check them out: [login to view URL] [login to view URL] We will both agree and set deliverable milestones against the full requirements and release payments as we go along. We do not envisage treating this as a ‘Big bang’ delivery and more of a phased approach so this project will require ongoing communication as we develop further solutions based on what you produce. You MUST be willing to do this as later you will be required to upscale this solution to 100+ websites for data scraping (as part of a new project which will upscaling this work) *****What do we want**** Someone experienced with: • Complex Data scraping across multiple website with complex structures and create an internal API based on this data (given similar data being pulled from 25 websites) * Knowledge of using proxies to avoid being blocked when scraping data • Development of Browser Extensions changing websites to display additional information • Someone experienced with developing extensions across multiple platforms (Windows, Mac, Android browsers) * A basic level experience of Business Intelligence tools * Ability to work with large amount of data in the business intelligence tool and suggest sensible dashboards ***Please can you provide examples of the above requirements from your experience **** Please insert ‘READ IT ALL’ at the top of your bid so we know you have read everything Further specification will require a signed NDA
ID del proyecto: 26398318

Información sobre el proyecto

13 propuestas
Proyecto remoto
Activo hace 4 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
Adjudicado a:
Avatar del usuario
Respected Sir/Mam! Hope you are fine. It's me Zain here. I am working as a full-stack developer. I m an expert in my profession. I apprehended your mentioned description. I assure you that I will sort out your problem as per my professional skills. I hope that you would like to work with me. Regarding the skills, you can trust to work with me. I assure you to fulfill your requirements. visit its, please. [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] kindly visit upwork profile for client feedback. [login to view URL] please feel free for contact Thanks. Regards: Zain Abbas
$800 USD en 7 días
3,9 (11 comentarios)
3,7
3,7
13 freelancers están ofertando un promedio de $604 USD por este trabajo
Avatar del usuario
I’ll develop an automated web scraping tool to extract all the needed data & provide a dashboard to control and follow up with the process as well as download the data in any format you may need it in (JSON, CSV, EXCEL, TEXT, XML, Google Sheets…). And I'll make the REST API & The Chrome Extension. I’ve made lots of data scraping scripts & tools (I use nodeJs which is a much more suitable choice for web scraping) for different types of websites & platforms with some strong anti-scraping walls. And managed to complete some really challenging scraping tasks over the years. Check my profile for some samples & reviews on similar projects. I don’t use any ready tools or platforms, Simply because they never give a 100% working service, Instead, I program scraping utilities from scratch using some of the most popular web technologies such as: ◘ NodeJs (js runtime for the server), ExpressJs (NodeJs framework), MongoDB (NoSQL database). ◘ Puppeteer (browser automation), Cheerio (Html loader) ... ◘ HTML, CSS, JavaScript ◘ VueJs (js framework), NuxtJs (VueJs helper). ◘ AdobeXD, Photoshop, Illustrator… (for design) Please contact me with more information & maybe even give an example of the data structure you want, then I can give you more details about the process of making such scraping tools & answer any questions you may have.
$550 USD en 7 días
5,0 (22 comentarios)
5,7
5,7
Avatar del usuario
READ IT ALL Hi, I have experience in dealing with web scraping, APIs and databases. My past projects include a eCommerce website with React as frontend, Node API as backend and MongoDB as database. For API I primarily use ExpressJS. I know how to do web scraping in Javascript using libraries such as Puppeteer and Cheerio. I think MongoDB or similar NoSQL would be good fit in this situation as you have a large set of data. I also have experience in making browser extension in Chrome but I'm willing to learn how to do in other browsers. Let's discuss further
$750 USD en 14 días
5,0 (3 comentarios)
5,4
5,4
Avatar del usuario
READ IT ALL Hello, my name is Puru. I have 6+ years experience in providing integrated development solutions including web automation and web scraping with industry-grade expertise in python, bs4, scrapy, selenium. I have scraped data from sites like amazon, facebook, twitter and other 50+ websites. My profile :- https://www.freelancer.com/u/Guptapuru304 Prior to bidding, I have carefully read the details of your project, and its requirements to get data from 25 sites and develop browser extension. I understand your needs and am ready to discuss and provide samples before we initiate the project. To get started, just send me a message :) Best, Puru
$1.500 USD en 7 días
5,0 (14 comentarios)
5,2
5,2
Avatar del usuario
I am a full-time Full Stack Freelance having 7+ years of experience and have team working on Web App Developer-Designer (Specialising in CRM, ERP, Ecommerce, Website Developing & Designing, Android Apps, Ios Apps, web-apps). We're also proficient in the following technologies; Php, Laravel, Codeigniter, WordPress, Magento, shopify, python, Python scripting, Data scraping, Selenium testing, MySQL, PostgreSQL, Django, DRF(Django Template, rest API, rest framework, unit test cases), artificial intelligence, machine learning, Java Developing, image processing, open cv, Deep learning, Sentimental analysis, Data science, Blockchain Developing, React Native, React js, nodejs, Angular js, Angular (All version JS), Express js, backbone js, React native, Mongo DB, vuejs, IOS Developing, Android Developing, Asp.Net, SEO, google adwords and Digital Marketing. Our work speaks for itself. We pride on our client's satisfaction and we've finished more than 340+ projects.
$500 USD en 7 días
5,0 (4 comentarios)
4,1
4,1
Avatar del usuario
I am pleased to inform you that our offering of Crawling Solutions will be the right solution to comply to your requirement. The functionalities of Scraping / Crawling Solutions is as mentioned below, - Fetch the details targeted websites in quick time - More than 98% accuracy in scraping the information - Provision of IP-Management and de-captcha resolution - More than 10 years of experience in industry domain - User defined output to be delivered i.e. excel / csv, JSON, HTML etc. - Output delivery via Email, FTP, API etc. Do let me know if you require further details from our side. We have experience in fetching the pricing and other information on a regular basis from more than 250 websites on a regular basis. The partial list of the websites are as mentioned below, - LinkedIn - Facebook - Twitter - Yellowpages - Super pages - Amazon - Ebay - Rakuten - Wallmart - Insight - Kikatek - CDiscount - Sephore - Bechtel - Farfetch - Zoho - Mouser - bestbuy - officedepot Do let me know if you require further details from our side.
$450 USD en 7 días
5,0 (1 comentario)
3,5
3,5
Avatar del usuario
READ IT ALL Nice to meet you. Thanks a lot for taking your valuable time to read my message. After readout your job description, I am very interested in your project and I believe I’m qualified for this task. I have +7 years experience in this field and have worked on many successful projects in the past. If you are looking for a highly skilled and rich experienced expert with a deep knowledge, a professional attitude, excellent communication skills and the highest code quality, then I'm the right person you are looking for. I'd like to discuss further more in details over chat with you I am so confident that my involvement in your project will bring it to a successful launch, on time and within budget. I look forward to your reply. Best Regard, Igor.
$500 USD en 10 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de UNITED KINGDOM
Milton Keynes, United Kingdom
5,0
12
Forma de pago verificada
Miembro desde abr 10, 2020

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.