Find Jobs
Hire Freelancers

Bash Scripting - Copy Files from Amazon S3 and Server

$30-250 USD

已完成
已发布将近 10 年前

$30-250 USD

货到付款
I need two bash scripts written: 1. We store many large video files on Amazon S3. I want a script written to copy a batch of files (could be 100+ files) from S3 to a folder on our linux server (which happens to be an Amazon EC2 server). I have used S3CMD before successfully but open to alternate methods. The file list would be on a separate txt file (could be csv if needed). Variables that should be able to be changed easily are source S3 bucket, and destination folder. Not sure how the concurrent number of files copying at once would work or what would be most efficient. Freelancer would need to advise on this issue. Meaning do we limit the number of concurrent files at once or ? some of the files could be 15 GB each so the copy method must include multi-part transfer (s3cmd offers this). Also need a report generated at the end of the copy that would report on successful transfers and/or files that were not located. 2. Second script is similar to #1 above but would copy from a server folder on the server that would be running the script. These would be mostly image files so not as large as the files on S3. Same variables as above (source and destination) and a report in the end that lists successes and files that cannot be found. Not sure of the price of the budget required on this.
项目 ID: 6171090

关于此项目

17提案
远程项目
活跃10 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
颁发给:
用户头像
Hi Randall, i like to write some Perl or bash script to automate the data transfer for you. .........
$166 USD 在5天之内
5.0 (15条评论)
4.6
4.6
17威客以平均价$132 USD来参与此工作竞价
用户头像
Dear Customer, this is Yaseen, and i am glad to work for you project. We specialise in Server Management, Enterprise Email Systems, Email Marketing and Asterisk VOIP Support. Please see my past projects https://www.freelancer.com/projects/Linux-VoIP/VICI-Anything-VPS-astrix-Channel.5694111.html https://www.freelancer.com/projects/Linux-VoIP/voipswitch-alternate-asterik.html https://www.freelancer.com/projects/Migration-reinstall-plesk-ispconfig.html https://www.freelancer.com/projects/Linux/issues-openVZ-server.html https://www.freelancer.com/projects/Proxmox-Server-network-setup-firewall.html https://www.freelancer.com/projects/linux-support-for-proxmox-firewall.html https://www.freelancer.com/projects/linux-support-for-proxmox-firewall.html https://www.freelancer.com/projects/PowerMTA-assistance-required.html
$210 USD 在3天之内
4.9 (319条评论)
7.5
7.5
用户头像
Hello, I have over 9 years experience as an Linux admin and strong experience with AWS services. I have created many custom backup scripts to copy files from/to S3 bucket and between servers. If you are interested we can discuss the solution more in details. Best Regards
$200 USD 在3天之内
5.0 (354条评论)
7.0
7.0
用户头像
Hi I work towards providing reliable, relevant and robust IT solutions at most competitive prices to my customers. I ensure 100% customer satisfaction so lets start Thanks
$190 USD 在7天之内
4.8 (100条评论)
6.8
6.8
用户头像
Hi, I (Myself a senior PHP, ASP.NET programmer using C# and VB) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bug-free codes at the very first instance. After seeing our quality of work and the cooperation offered to you even after the work has been delivered to you, you’ll come to us again and again to avail our services. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I can achieve the results that you are asking for within your timeframe and budget. I am confident I can exceed your expectations and I would love to work on your project. Thanks, Priyanka
$263 USD 在10天之内
5.0 (14条评论)
5.1
5.1
用户头像
Hello, I have worked with AWS EC2 in Bash using their command line interface. I can check their S3 command line reference and do your project. I can start working today. Thanks.
$70 USD 在1天之内
4.8 (55条评论)
5.0
5.0
用户头像
I have worked with Amazon EC2 and S3, i have also worked with s3cmd in python. This problem sounds challenging to me and I would like to work on this I have 5 years of professional experience.
$200 USD 在3天之内
4.7 (11条评论)
4.6
4.6
用户头像
Hi I know better much more methods with file transfering and can write this fcripts for you SSH root access is requied *****************************************************
$100 USD 在3天之内
4.6 (17条评论)
4.2
4.2
用户头像
Hello! I have made the similar script earlier, besides, I have extensive experience in shell scripts development. - No need csv. - All variables (as always) will be in head of the script. Furthermore, you will be able defile and other settings: how many files transfer, which size (for each file and for total) are allowed. - The multi-part (multithreading) supported by s3cmd. - will check md5sum.
$50 USD 在2天之内
5.0 (2条评论)
1.7
1.7
用户头像
I'm having good exposure of shell script and cloud computing. We can have discussion if you are interested.
$155 USD 在3天之内
5.0 (1条评论)
0.8
0.8
用户头像
Hello, I am the right person you need for this task ! I am a Sys Admin and bash scripting for tasks like this one is really my daily work. You are right to be unsure of the Project Budget you proposed : $250 is too much. I think around $60 is enough ;-)
$55 USD 在3天之内
0.0 (0条评论)
0.0
0.0
用户头像
Dear Sir, We are the globalized software services organization specialized in providing Mobile, ECommerce and Social media frameworks using cutting edge and emerging technology. Leveraging best-in-class people, processes, and technologies, Veltrod provides high-quality software development and consulting services to independent software vendors and enterprises with WOW factor. We are specialized in providing solutions on the below mentioned areas. Mobile application development (iPhone, Android, BB, Windows Mobile) | ECommerce Solutions | Windows application development | Web application development (Open Source,.NET, JAVA) | Cloud based solution |Image Editing | Casino Games development | Independent testing Please let us know if you have any such requirements. So that, we can discuss further and develop high quality solution with low cost. Thanks & Regards, Santhosh Kumar .J
$144 USD 在3天之内
0.0 (1条评论)
0.0
0.0
用户头像
Hello, I would like to do that project for you, please check my porftolio for my bash scripting samples. Hope to talk with you soon, best regards!
$45 USD 在1天之内
0.0 (0条评论)
0.0
0.0
用户头像
I do Linux admin with Bash all the time. This task would not be difficult for me to do. You probably want to use FTP or HTTP PUT method, unless you need encryption, which could use SFTP or HTTPS. You also want to verify the data by calculating SHA1 hashes of all the files. The script will need to be able to login to the EC2 server, by running s3cmd and using your SSH login. It is also possible to do this without typing a password, using an SSH host key. Another possibility is that the files on the S3 server are publicly available via HTTP. In that case, a script using wget or curl could download all the files, while running on the EC2 server.
$30 USD 在2天之内
0.0 (0条评论)
0.0
0.0
用户头像
Hey, I have good idea in creating scripts. If you like me to proceed, please give me complete details of servers paths etc. Do send me complete documentation with clear details. Otherwise, project cannot be done in 6 days. If i have clear details, it won't take that much days too. :) Regards, Rajesh.
$137 USD 在5天之内
0.0 (0条评论)
0.0
0.0

关于客户

UNITED STATES的国旗
Brentwood, United States
5.0
25
付款方式已验证
会员自8月 24, 2005起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。