***Do NOT bid on this project until you read the details CAREFULLY. Otherwise, I will mark the bid as spam. ***
I need someone to create a script/program/etc. to perform a data merge operation for me.
I have a CSV file that is 1.5GB with 4 million rows of data. I need to merge rows together based on a set of conditions.
Because of the file size, I cannot open it with Excel and breaking it into groups of 1 million is not an option.
Open the attached Excel file so that you can see a BEFORE shot of how my data looks as well as an AFTER shot of how I want it to look once completed.
Condition 1
If the Phone and URL are the same as another records Phone and URL… AND fields First, Last, and Email are blank, copy data from any other record with a matching Phone and URL.
Goal: The goal of this tasks is to ensure that there are no records that have a blank First and Last name if another record exist with the same Phone and URL. (Later, I will run another program that will remove the duplicate row. I do not want to do that now unless it is a requirement.
Condition 2
If the URL is the same as another records URL… and the email address is info@ and there is only 1 record with a First name (and blank email with that First name), copy the info@ email address to the record WITH a First and Last name.
Goal: The goal here is to assign the info@ email account to a name. Most of my records are small businesses and the info@ should go to the contact I have on file.
My ultimate goal is to merge data together so that I can remove records that do not provide any new (non-duplicate) data. Meaning, if I have two records that have the same data, I will purge it using another merging software that I have.
NOTE: My tab delimiter is currently a ^ instead of a comma. The reason is because I am using another program for another portion of the merge and commas have caused issues but ^ does not.
If you can help me accomplish this task, add the following line above your bid…
I have read the details in full and reviewed the Excel file.
Give me an idea of how you will accomplish this tasks. You can tell me in private message.
Let me know of any questions that you have.
Although there are other fields, I do not need those copied over – just the fields we have mentioned. The other program will take care of that.
NOTE: I will be away Friday - Sunday afternoon. If you have a working solution, show me or send it to me and that will greatly help me in selecting you. I will respond to messages once I return for any messages sent Friday - Sunday.
p.s.
so if I awarded then you have send me this csv zipped and with ms Access I can merge rows etc and to export that to Excel -- but that will be a GUI , so you'll have buttons to export result file to Excel with asking a folder placement etc
Hi, I can code via Ms Access with Excel automation.
Relevant Skills and Experience
ms Access/Excel/VB programmer since Ms Office 97 released
Proposed Milestones
$225 USD - default
$225 USD en 5 días
5,0 (4 comentarios)
2,8
2,8
14 freelancers están ofertando un promedio de $212 USD por este trabajo
Hi, sir
I have looked your requirements and I get what u want.
I think this program should be made by c/c++ or c# for performance.
My price and period is negotiable
We can discuss the details via chat
Relevant Skills and Experience
I have much experience in csv processing so I'm sure I can complete this.
Proposed Milestones
$222 USD - done
Hello How are you
this is very big data .
I can treat big data with php
No problem
Relevant Skills and Experience
PHP
Proposed Milestones
$155 USD - price of project
I have gone throw your entire message and I hope I can do this one. but one quick question can you provide few lines from the CSV file that will understand how the data is actully coming, so I can do
Relevant Skills and Experience
VBA excel.
Proposed Milestones
$250 USD - final payment
I am an IITK graduate and I have 9 years of experience in software development. I have 100% completion rate and I have finished all the projects with the highest level of customer satisfaction.
Relevant Skills and Experience
I usually finish projects with ease on which other freelancers have already given up. I learn and understand new stuff very fast and finish the job with top quality and reliability.
Proposed Milestones
$155 USD - test
Hello, I have read the details in full and reviewed the Excel file.
Relevant Skills and Experience
Expert in Data Processing
Proposed Milestones
$250 USD - Default
Do you want the script or just the new merged file?
I have read the details in full and reviewed the Excel file. I was thinking about doing this jointure using Acces and sql requests than using Excel.
Expérience et Compétences appropriées
Excel/VBA Access
Étapes proposées
$100 USD - m
hi there
if you need to manahe large amount of data i suggest you to use a database instead of a file or excel
what i can do is to load thw data in a sql server and apply then the rules that you sent..
if you wabt i can export the processed data to a exvel file or a txt file.. or i can send you the backup db file so you can restore it in your location
regards
carlos
I have read the details full and reviewed the excel file.
I can compete the functionality using php script with arrays.
Please allow me to start the project. accept the bid and create the milestone.
Regards
SHIHAN
I have read the details in full and reviewed the Excel file.
Relevant Skills and Experience
Web Search
Web Scrapping
Excel
Data Processing
Data Collecting (Using Macro)
VBA
Mathematics
Excel VBA Macro
Automation
User Forms
Data Analyzing
Proposed Milestones
$155 USD - Full and Final
I have read the details in full and reviewed the Excel file.
I am planing to write some java or python program to solve this problem.
Relevant Skills and Experience
I feel Hashmaps concept work for both conditions. So i will use them in my code for merging.
Proposed Milestones
$140 USD - Complete project
Have few questions. If you want to assign to me then we can discuss more.