Find Jobs
Hire Freelancers

reliable and affordable solution for amazon product scraping at scale

$250-750 USD

已关闭
已发布超过 2 年前

$250-750 USD

货到付款
hello i m looking for an affordable solution (open to everything be it proxies or whatever you come up with) to scrape huge amount product on amazon we are talking about 10 millions product page a day which is about 30 Terrabyte a day i m not looking for the scraper I already built it , I know how to google proxies provider I am looking for someone that had a similar problem and solved it in an interesting way :) not looking to spend 50k$/mo DO READ FULL DESCRIPTION BEFORE APPLYING THANKS
项目 ID: 31320357

关于此项目

14提案
远程项目
活跃3 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
14威客以平均价$524 USD来参与此工作竞价
用户头像
Hey Manager!! We checked for your project and interested in your project. Project: reliable and affordable solution for amazon product scraping at scale I am an expert full stack developer with skills including Software Architecture, Web Scraping, Python, Amazon Web Services and Reverse Engineering.
 I have done several complex projects and provide continuous maintenance support. My goal has always been to provide reliable and efficient to my clients and so far I have been quite successful. I won't delay your project and will keep you updated with constant feedback and status of the work My Full Stack Development Skills 1. Frontend: Front-End HTML5, CSS/CSS 3, JavaScript, 2. Server Administration: Amazon Web Services, Digital Ocean, LAMP, Cloud, Apache, Apache Tomcat, NGINX. 3. Backend: PHP, GoLang, Ruby, Python, Laravel, CI, CakePHP. 4. Databases: Mysql, Oracle, PostgreSQL, MS SQL, SQLite, MongoDB. 5. Testing: Manual & Automation testing. 6. Frameworks: Angular Js, React JS, Symfony2, Laravel, Silex, Spring MVC, Rails, Django, Pyramid, Protractor, Selenium, Blockchain, Etherume, Vuejs 7. UI/UX: Photoshop, Sketch, Zeplin, Invision, Moqups. Type of projects we have delivered to our global clients: a. Enterprise Software Development, b. CRM Development, c. SAAS Product Development c. Web/Mobile Based Application development. d. All CMS website: Wordpress, Magento, Joomla, e. HRMS Software f. Multi-level Marketing (MLM) with crypto payment gateway f. E-commerce installation and customization g. Crypto Exchange Development Please send a message to discuss more regarding this project.
$610 USD 在10天之内
5.0 (9条评论)
6.0
6.0
用户头像
Hi! I can help you with this project. I am running large scale Instagram, deezer, spotify, youtube-music Automation and scraping. Have got around 700+ private proxies, got rich experience with anti-captcha and phone verification methods. How will i scrape 10 million amazon web pages each day? You already have the scraper built, and i have a cloud based architecture to support scaling from 1 to 10000 servers in a very little time. I will integrate the scraping script to my architecture, thus making large scale scraping possible. And then using the proxies i have, will scrape the data. So basically i am proposing that, i will provide a cloud based architecture and can also rent out my proxies, so you will incur significant reduction in proxy expense. You may use your own servers or we can resort to aws or google cloud. Regarding storage, depending on your choice of server we can either store locally or on cloud storage. Note that using cloud storage adds more cost to the process. To conclude, i am solving your problem by providing you an architecture for scraping that will make scraping at scale fun for you. And i am offering to rent out my proxies thereby reducing the cost significantly. If more proxies be needed, we can use rotating proxies. OR, you can simply get the data from us (i.e. you buy no resources you only pay for the data), but that will require upfront payment If this sounds like a solution, lets chat more. Note: Regards, Hamza Zubair
$500 USD 在7天之内
5.0 (20条评论)
6.0
6.0
用户头像
Hi, I have faced similar problem during scraping data from amazon, 100k products per day from amazon. After more and more research finally I found one solution, i will discuss on private chat only. you will have to pay $90 per month only, 100% guarantee will work. I have 6+ years industry experience in Python, Machine Learning, Web crawling, Web Scraping, Data extraction, Excel, MySQL (RDBMS), Mongo DB (No Sql) database etc. Expert in excel data manipulation, excel auto report generation using pandas, numpy in python. (Fully automation) I have built crawler for approx. 400+ website like Amazon, ebay, flipkart, walmart, bestbuy, shopee, snapdeal, and most of OEM website etc. I have done advance level of crawling using “API” and “POST” method also. I can scrape any difficult site so can you please provide me this project. I won't disappoint you. Thank you.
$350 USD 在3天之内
5.0 (16条评论)
4.1
4.1
用户头像
Hi I'm a Python software developer with 7+ years of experience. My expertise is covering full ETL pipeline, exactly web scraping, crawling and data processing, data loading to any databases. Strong background in creating web applications and API, bots programming and any kind of web automation solutions. Feel free to contact me if you have any available work ;) Range of tasks: • Web scraping, crawling, parsing and data extraction & preparation (ETL) • Bypass any captchas, prevent IP blocking and bots detection • Development of web applications, API's, etc • Automation software: bots, tests, etc • Configuration and deployment of infrastructure (Cloud-, Server-, Container-based) Technical skills: • Databases: MongoDB, MySQL, SQLite, PostgreSQL, etc • Tools for scraping: Scrapy, Selenium WebDriver, css+xpath, BeautifulSoap, etc
$750 USD 在7天之内
5.0 (2条评论)
2.6
2.6
用户头像
Hey! I am professional Python computer programmer. I am familiar with Python and I have a lot of work experiences in Amazon Web Services, Python, Software Architecture, Reverse Engineering and Web Scraping. I can start right away. I want to discuss for this project in detail. Please send a message to discuss more regarding this project. Hope to hear from you soon
$400 USD 在5天之内
4.1 (3条评论)
2.6
2.6
用户头像
Hi, I will do reliable and affordable solution for amazon product scraping at scale I am an experienced Web developer and equipped with all the necessary skills to provide you best website that completely satisfies your business needs. Please share your requirements with me over chat so we can proceed further. Best Regards, Nachita
$500 USD 在7天之内
5.0 (1条评论)
0.3
0.3
用户头像
Hi I read your project description for web scraping and am sure I can give you quality work. I have expertise in web scraping. And I will make it at your given price and time.I will given you solution to scrap huge amount of data I can guarantee: • No deadline break/delay, always deliver project a specified time. • Great communication skills with the ability to convey ideas clearly with an emphasis on client satisfaction. Please have a quick chat discussion and let me know your thoughts. I can easily pick up instructions. I am very flexible and multitasking. And you can trust me Thanks
$500 USD 在7天之内
0.0 (0条评论)
0.0
0.0

关于客户

ISRAEL的国旗
PARIS, Israel
5.0
14
付款方式已验证
会员自8月 22, 2018起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。