Find Jobs
Hire Freelancers

Data Processing using Python and SQL

$30-250 USD

已完成
已发布大约 4 年前

$30-250 USD

货到付款
I am converting some hive tabular data into JSON documents in python using a UDF. So basically each row in the output text/csv files has two columns. first column has sequence number and the second column has a JSON object as a string. Each day we may have atleast 100 files (text/csv). The total row count in these files can be in millions. This project is to batch these rows by ignoring the sequence number and take atleast 1000 JSONs and create an array of JSONs and then assign a new batch number to that batch. If it can be done in hive table as post processing that is fine too.
项目 ID: 24768897

关于此项目

19提案
远程项目
活跃4 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
颁发给:
用户头像
hello complete within max 36hrs I would like to work on your project. I have a 5+ years of experience in field I can start working immediately on this project if needed. I have gone through the job description and understand your requirements.I can complete this work with high quality. I would really like to work with you on this [login to view URL] interested,Kindly contact me via chat for further details and discussion
$100 USD 在1天之内
4.9 (32条评论)
5.1
5.1
19威客以平均价$135 USD来参与此工作竞价
用户头像
Hello, I'd be glad to develop the python script that performs the required json processing . Looking forward to chat with you soon for more details. Best regards.
$140 USD 在2天之内
5.0 (167条评论)
7.4
7.4
用户头像
Hello, I can help you with your project - Data Processing using Python and SQL I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
$220 USD 在4天之内
5.0 (66条评论)
6.8
6.8
用户头像
so you want to take all the rows across all the days txt files, strip out the batch and import into one CSV with a new batch number?
$99 USD 在5天之内
5.0 (16条评论)
5.8
5.8
用户头像
Hello Nice to meet you. I already read your job description and understood your requirments. I have rich experiences in this field and python is my top skill. So i can complete your project on time. Let's discuss more via chat. Thanks.
$200 USD 在7天之内
5.0 (6条评论)
4.1
4.1
用户头像
Hi Sir, I hope you are doing well. I have round about 10 years of experience in Python and can work with you on this script. Please contact. Thanks
$99 USD 在3天之内
5.0 (4条评论)
4.1
4.1
用户头像
Hi, I am an expert in processing data using python. I have processed many data files(csv, xlsx, jsson, xml) for SEO. I think I can complete your project successfully. Thanks
$140 USD 在7天之内
5.0 (3条评论)
4.0
4.0
用户头像
Hello, I have read your requirements and I can build python script that fulfill task you require. You can check out my skills at my profile. lets discuss more about project in chat. thank you.
$70 USD 在3天之内
5.0 (14条评论)
4.1
4.1
用户头像
Hi, I can build that for you. It's really about creating the right input hooks, batching the data and writing it in the right location. I'll include proper logging and design the script with flexibility in mind. Regards, Nikolay Kovachev
$99 USD 在7天之内
5.0 (1条评论)
3.7
3.7
用户头像
Hello. I am an experienced Python developer. I own a wide stack of technologies. Always attentive and honest with the customer. Write me to discuss the details of the project.
$100 USD 在7天之内
5.0 (2条评论)
2.4
2.4
用户头像
sir I am expert like this job each day I can complete 1k row if you want I can use my expert team so please contact me
$100 USD 在3天之内
4.9 (2条评论)
2.0
2.0
用户头像
I am python expert and can do this. contact me for further deliberations............................................................. regards Ginu
$140 USD 在7天之内
5.0 (1条评论)
1.5
1.5
用户头像
Hello, I am a data analyst by profession and Im expertise dealing any format of the data in Python, pandas library. I would love to take up your project. Please let me know if you are interested. -David.
$45 USD 在2天之内
0.0 (0条评论)
0.0
0.0
用户头像
I can deliver this project in both Hive and Python. I have 7+ years exp in SQL analytics and ETL processes in Big Data both in Cloud and on premise. I am new to freelancer so there are no past projects but I can guarantee that the code will be of good quality and quite efficient
$100 USD 在7天之内
0.0 (0条评论)
0.0
0.0
用户头像
Are you going to insert to SQL Server or MySQL?. if you are running this in linux machine, we can make a cron for this task. The things that is not clear is the batch sequence, are we going to put the batch no to the table?. that means in the table we have 3 column Seq, Data, and Batch ?..
$120 USD 在7天之内
0.0 (0条评论)
0.0
0.0
用户头像
Hello There, I'm a professional back-end and I can assure of you a robust and scalable solution for a problem like this. My approach would be to concurrently process the rows in groups of X and tag them with batch_ids as we along, allowing us to get many a time faster results. Drop me a message if this interests you, I'd be happy to discuss this in detail. Regards, Mandeep
$200 USD 在7天之内
0.0 (0条评论)
0.0
0.0
用户头像
Greetings, We are a company working for the last 5 years, but we are new to freelancer.com, so you might find our profile new. Our reviews do not display the amount of work that we have done, so you can go through our website - hrtechservices dot com. We read your job description and surely, we can help you out. We have a team of 120+ expertise, which includes website developer, Software Developers, Mobile Developers, Testers, Project Managers, and Quality Manages. We have developed over 250+ websites, software, & application for different business sectors and industries. Skills: 1. Backend- Python, machine learning, AR/VR, PHP (Laravel, Codeigniter, CakePHP, CorePHP, etc), etc. 2. Frontend- HTML5/CSS3, Angular JS, Bootstrapping, Javascript, jQuery, Node JS, Vue JS. etc. 3. CMS: WordPress, Wix, Magento and Shopify. 4. Database- MySql, MsSql, SQLite, etc. 5. Android Coding- Java, Kotlin. 6. Hybrid framework- React Native, Flutter. 7. iOS Coding- Swift, objective-c. 8. Advance Level Skills- IoT, Alexa Skills, Data Visualization, Machine Learning. 9. Designing tools: Adobe Photoshop, Adobe Illustrator, Adobe XD, Sketch, Invision and Figma. We are ready to start work on an immediate basis. Looking forward to your reply Thanks & Regards HrTechLLC
$210 USD 在8天之内
0.0 (0条评论)
0.0
0.0
用户头像
I have worked extensively in python and Spark processing various kinds of files like json,csv or text files.I am also well versed in Hive.
$140 USD 在7天之内
0.0 (0条评论)
0.0
0.0

关于客户

UNITED STATES的国旗
Chicago, United States
4.6
2
付款方式已验证
会员自2月 4, 2018起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。