Find Jobs
Hire Freelancers

Python App Performance Improvement

$30-250 USD

进行中
已发布将近 6 年前

$30-250 USD

货到付款
We need to improve performance of a Python app. It is a simple spider. Collects data and reports them back to primary app. Its task is to visit URLs input by users, crawl them, collect data and report back. Currently, can handle only a few thousands URL per day. It must be able to handle 1+ million. Also, URL checking queue gets blocked for whatever reason and that must be debugged as well. Might be Python issue or other. ============== SKILLS: ============== Python, Terminal access WHM cPanel = optional = PHP Laravel Vue ============== TASK: ============== - improve performance of the spider - debug and fix any issues ============== DEADLINE ============== 11th May 2018 ============== BUDGET ============== $120 Primary requirement is Python but PHP, Laravel, Vue knowledge would help. You will be provided access to GitHub to check out the code. Also test user account is available so you can see it in action. Also, please mention word "bee" at the start of your reply to prove that you read this far.
项目 ID: 16915037

关于此项目

7提案
远程项目
活跃6 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
7威客以平均价$236 USD来参与此工作竞价
用户头像
Sir/Madam, I am an experienced Python developer with 2 years of experience in web scraping using selenium, requests and beautiful soup. I can do this project for you. Please go through my profile. I look forward to working with you on this. Have a great day ahead. Thank you Yash
$155 USD 在3天之内
5.0 (42条评论)
5.2
5.2
用户头像
Hello, I'm a python specialist with a vast experience in web apis/apps. Looking at your requirements I can implement a combination of asynchronous/non-synchronous architectures to boost your spiders crawl speed close to your hardware limitations. I cannot guarantee an exact performance metric as this will depend on server resources and network connectivity. I expect up to 100 fold improvement in speed. I offer all clients a one month warranty period to resolve any issues that may be discovered after project completion. Kind regards I look forward to hearing from you. I have recently built a working high speed spider and can implement a similar version for you very quickly
$600 USD 在2天之内
4.9 (8条评论)
4.7
4.7
用户头像
bee! You're asking for a vast improvement but I can certainly take a look. I'd be looking for ways to enable the crawler to run multiple tasks concurrently, that way you can make it run as fast as you like, just add more hardware!
$277 USD 在3天之内
0.0 (0条评论)
0.0
0.0

关于客户

SLOVAKIA的国旗
Orchard Towers, Slovakia
5.0
6
付款方式已验证
会员自2月 11, 2018起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。