Find Jobs
Hire Freelancers

Build automated data load from websites (automation) & APIs to Postgresql/MS-SQL

₹37500-75000 INR

Cerrado
Publicado hace casi 6 años

₹37500-75000 INR

Pagado a la entrega
We are a startup focussing on blockchain products. One of our project details are as below for which we are looking for a team of freelancers with various skill set who can together build the product. Phase 1 (Duration: 7 days): IT solution to collect, load and process data from various websites. Data will be available : 1. Standard APIs of those websites (json format) 2. Websites crawls (by Automation to collect tabular data) Need to build batch automated processes to collect these data and load in Postgresql/MS-SQL on defined interval of time. This would require setting of PostgresqlMS-SQL server on Ubuntu latest version and further processing to consolidate collected data in desired tables' format. Which requires processing via stored procedures. Parameters, like, frequency of batch run and hyperlink of the API/Website to crawl should be read from a database table. Solution should be generalised, such that, similar pattern websites are read similarly. Ex: 1. Standard APIs (samples): [login to view URL] [login to view URL] [login to view URL] 2. Websites Data Crawl (samples): [login to view URL] [login to view URL] [login to view URL] Once data is collected directly from these websites, it needs to be processed and collated in target summary tables based upon few business logics. Phase 2 (duration: 4 weeks) & 3 (duration: 3 weeks): To be discussed once approaching finish of phase 1. Skills needed for phase 1: JSON processing, API processing, Automation to crawl websites and collect data, Postgresql/MS-SQL scripting, database knowledge etc.
ID del proyecto: 17387188

Información sobre el proyecto

11 propuestas
Proyecto remoto
Activo hace 6 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
11 freelancers están ofertando un promedio de ₹69.924 INR por este trabajo
Avatar del usuario
Dear ukrblockchains, I have experience with these skills. I do have similar experience doing something similar to yours "Build automated data load from websites (automation) & APIs to Postgresql/MS-SQL" therefore I am looking forward to discuss and move ahead. Relevant Skills and Experience I have 10+ years of experience in API, JSON, Microsoft SQL Server, Selenium Webdriver, Website Design I can do this within your budget too ₹37500 - ₹75000 INR please check more from here https://www.freelancer.com/u/mmadi.html?page=portfolio I am ready to work with you,kindly waiting for your response. Thanks & Regards, Mmadi
₹52.500 INR en 24 días
5,0 (16 comentarios)
6,3
6,3
Avatar del usuario
Looking for Mobile App Solutions, we've got you covered. Contact us today, our developers are eager to solve your problems.. We specialize in Hybrid and Native Mobile Apps. Our prices are affordable. Contact us today.
₹62.500 INR en 20 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
I can do your job.
₹66.666 INR en 20 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Hello! This appears to be similar to work I did to build data marts hence loading data and writing stored procedures is not an issue
₹62.500 INR en 20 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Hi, I have work experience related to Web Crawling, Data Extraction. Currently Working as Data Science. Have knowledge of Postgress, Distributed System.
₹62.500 INR en 24 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de INDIA
India
0,0
0
Miembro desde jul 18, 2018

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.