Find Jobs
Hire Freelancers

AWS DynamoDB/RDS/Redshift Database Schema Design

$30-250 USD

Cerrado
Publicado hace más de 8 años

$30-250 USD

Pagado a la entrega
Decide on the best database to use and design the most cost-effective and appropriate database schema based on application needs. We use AWS to host all of our servers and prefer to continue using them for this database but ultimately want to use the best database for the job. This database will be used to store all compromised user information found on the internet with the key identifier being a users email address. Each hack data inserted into the database may contain different information associated with a user. Similar services include [login to view URL] and [login to view URL] The following link described how one service did it with Azure. [login to view URL] <b>Database Requirements:</b> - Ability to scale to billions of rows - Quickly return results for an email address. (results generated in milliseconds) - Quickly return all the results for a given email domain. (results generated in milliseconds) - Store all associated information related to the email address. - Store lots of unstructured data related to the email address. - Allow for detailed reporting of certain data points. (What is the most common password, what is the most common email domain, etc) <b>Normal searches on the database:</b> 1. Search based on a specific email. 2. Search based on a specific email domain. <b>Deliverables:</b> 1. Suggested Database 2. Suggested Database Schema 3. How do we deal with multiple reported hacks on an individual email address? Do we only allow one "database row" for each email address or a new row every time a new hack is discovered? 20% - 30%+ of most emails are duplicates 4. Help setting up the initial database on AWS.
ID del proyecto: 9130768

Información sobre el proyecto

4 propuestas
Proyecto remoto
Activo hace 8 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
4 freelancers están ofertando un promedio de $189 USD por este trabajo
Avatar del usuario
Hello, I am an American developer living in Japan. I have looked over your requirements and I think you have a few good options: DynamoDB with a main index of Email, Mongo backed with Elastic Search - Super fast text search with an index size that can easily fit into most RAM. (in the millions of items) Thanks, Wyatt
$222 USD en 3 días
5,0 (1 comentario)
2,7
2,7
Avatar del usuario
I will do it. i have more than 6 years experience in aws
$111 USD en 1 día
4,9 (5 comentarios)
2,5
2,5
Avatar del usuario
A proposal has not yet been provided
$137 USD en 7 días
5,0 (2 comentarios)
2,2
2,2
Avatar del usuario
Currently I work as data analyst in a web travel company owned by Recruit Inc, Japan, already for 6 months. Previously I was positioned as Database Administrator in the same company for 1 years. Works with various database environment: Oracle, MySQL, Percona, PostgreSQL, SQL server, and MongoDB. My company is also using AWS RDS for databases and EC2 for servers. Experience: - Make stored procedure in SQL server for finance company (from BlackBerry, survey form application to be inserted to DB) - Import & export database, upgrade Oracle version from 10g to 11g - Convert Oracle SQL schema to MongoDB NoSQL schema for hotel reservation website. - Oracle indexing, query design, making other objects such as view, trigger to help Java developer team. If approved let's talk about detail. Thank you
$222 USD en 3 días
5,0 (1 comentario)
0,0
0,0
Avatar del usuario
This turns out to be a apt use-case for a distributed document database/key-value store with indexing on the email id and shards also based on the email id. Also regarding the search on email domain, one of the key in the document will be email domain so that will make it a straight forward search. Since the database is a document store, we are in theory allowing only one document(row) per compromised email storing information about the hacks notified from different sources. I have implemented the same for one of the internal chat services. Feel free to reach out to discuss in more detail.
$222 USD en 2 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de INDONESIA
jakarta utara, Indonesia
0,0
0
Miembro desde oct 9, 2013

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.