Find Jobs
Hire Freelancers

Bash Scripting - Copy Files from Amazon S3 and Server

$30-250 USD

Terminado
Publicado hace casi 10 años

$30-250 USD

Pagado a la entrega
I need two bash scripts written: 1. We store many large video files on Amazon S3. I want a script written to copy a batch of files (could be 100+ files) from S3 to a folder on our linux server (which happens to be an Amazon EC2 server). I have used S3CMD before successfully but open to alternate methods. The file list would be on a separate txt file (could be csv if needed). Variables that should be able to be changed easily are source S3 bucket, and destination folder. Not sure how the concurrent number of files copying at once would work or what would be most efficient. Freelancer would need to advise on this issue. Meaning do we limit the number of concurrent files at once or ? some of the files could be 15 GB each so the copy method must include multi-part transfer (s3cmd offers this). Also need a report generated at the end of the copy that would report on successful transfers and/or files that were not located. 2. Second script is similar to #1 above but would copy from a server folder on the server that would be running the script. These would be mostly image files so not as large as the files on S3. Same variables as above (source and destination) and a report in the end that lists successes and files that cannot be found. Not sure of the price of the budget required on this.
ID del proyecto: 6171090

Información sobre el proyecto

17 propuestas
Proyecto remoto
Activo hace 10 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
Adjudicado a:
Avatar del usuario
Hi Randall, i like to write some Perl or bash script to automate the data transfer for you. .........
$166 USD en 5 días
5,0 (15 comentarios)
4,6
4,6
17 freelancers están ofertando un promedio de $132 USD por este trabajo
Avatar del usuario
Dear Customer, this is Yaseen, and i am glad to work for you project. We specialise in Server Management, Enterprise Email Systems, Email Marketing and Asterisk VOIP Support. Please see my past projects https://www.freelancer.com/projects/Linux-VoIP/VICI-Anything-VPS-astrix-Channel.5694111.html https://www.freelancer.com/projects/Linux-VoIP/voipswitch-alternate-asterik.html https://www.freelancer.com/projects/Migration-reinstall-plesk-ispconfig.html https://www.freelancer.com/projects/Linux/issues-openVZ-server.html https://www.freelancer.com/projects/Proxmox-Server-network-setup-firewall.html https://www.freelancer.com/projects/linux-support-for-proxmox-firewall.html https://www.freelancer.com/projects/linux-support-for-proxmox-firewall.html https://www.freelancer.com/projects/PowerMTA-assistance-required.html
$210 USD en 3 días
4,9 (319 comentarios)
7,5
7,5
Avatar del usuario
Hello, I have over 9 years experience as an Linux admin and strong experience with AWS services. I have created many custom backup scripts to copy files from/to S3 bucket and between servers. If you are interested we can discuss the solution more in details. Best Regards
$200 USD en 3 días
5,0 (354 comentarios)
7,0
7,0
Avatar del usuario
Hi I work towards providing reliable, relevant and robust IT solutions at most competitive prices to my customers. I ensure 100% customer satisfaction so lets start Thanks
$190 USD en 7 días
4,8 (100 comentarios)
6,8
6,8
Avatar del usuario
Hi, I (Myself a senior PHP, ASP.NET programmer using C# and VB) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bug-free codes at the very first instance. After seeing our quality of work and the cooperation offered to you even after the work has been delivered to you, you’ll come to us again and again to avail our services. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I can achieve the results that you are asking for within your timeframe and budget. I am confident I can exceed your expectations and I would love to work on your project. Thanks, Priyanka
$263 USD en 10 días
5,0 (14 comentarios)
5,1
5,1
Avatar del usuario
Hello, I have worked with AWS EC2 in Bash using their command line interface. I can check their S3 command line reference and do your project. I can start working today. Thanks.
$70 USD en 1 día
4,8 (55 comentarios)
5,0
5,0
Avatar del usuario
I have worked with Amazon EC2 and S3, i have also worked with s3cmd in python. This problem sounds challenging to me and I would like to work on this I have 5 years of professional experience.
$200 USD en 3 días
4,7 (11 comentarios)
4,6
4,6
Avatar del usuario
Hi I know better much more methods with file transfering and can write this fcripts for you SSH root access is requied *****************************************************
$100 USD en 3 días
4,6 (17 comentarios)
4,2
4,2
Avatar del usuario
Hello! I have made the similar script earlier, besides, I have extensive experience in shell scripts development. - No need csv. - All variables (as always) will be in head of the script. Furthermore, you will be able defile and other settings: how many files transfer, which size (for each file and for total) are allowed. - The multi-part (multithreading) supported by s3cmd. - will check md5sum.
$50 USD en 2 días
5,0 (2 comentarios)
1,7
1,7
Avatar del usuario
I'm having good exposure of shell script and cloud computing. We can have discussion if you are interested.
$155 USD en 3 días
5,0 (1 comentario)
0,8
0,8
Avatar del usuario
Hello, I am the right person you need for this task ! I am a Sys Admin and bash scripting for tasks like this one is really my daily work. You are right to be unsure of the Project Budget you proposed : $250 is too much. I think around $60 is enough ;-)
$55 USD en 3 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Dear Sir, We are the globalized software services organization specialized in providing Mobile, ECommerce and Social media frameworks using cutting edge and emerging technology. Leveraging best-in-class people, processes, and technologies, Veltrod provides high-quality software development and consulting services to independent software vendors and enterprises with WOW factor. We are specialized in providing solutions on the below mentioned areas. Mobile application development (iPhone, Android, BB, Windows Mobile) | ECommerce Solutions | Windows application development | Web application development (Open Source,.NET, JAVA) | Cloud based solution |Image Editing | Casino Games development | Independent testing Please let us know if you have any such requirements. So that, we can discuss further and develop high quality solution with low cost. Thanks & Regards, Santhosh Kumar .J
$144 USD en 3 días
0,0 (1 comentario)
0,0
0,0
Avatar del usuario
Hello, I would like to do that project for you, please check my porftolio for my bash scripting samples. Hope to talk with you soon, best regards!
$45 USD en 1 día
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
I do Linux admin with Bash all the time. This task would not be difficult for me to do. You probably want to use FTP or HTTP PUT method, unless you need encryption, which could use SFTP or HTTPS. You also want to verify the data by calculating SHA1 hashes of all the files. The script will need to be able to login to the EC2 server, by running s3cmd and using your SSH login. It is also possible to do this without typing a password, using an SSH host key. Another possibility is that the files on the S3 server are publicly available via HTTP. In that case, a script using wget or curl could download all the files, while running on the EC2 server.
$30 USD en 2 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Hey, I have good idea in creating scripts. If you like me to proceed, please give me complete details of servers paths etc. Do send me complete documentation with clear details. Otherwise, project cannot be done in 6 days. If i have clear details, it won't take that much days too. :) Regards, Rajesh.
$137 USD en 5 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de UNITED STATES
Brentwood, United States
5,0
25
Forma de pago verificada
Miembro desde ago 24, 2005

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.