Python scraping, scrapy expert for long term position.

已取消 已发布的 4 年前 货到付款
已取消 货到付款

We have a highly customised scraping pipeline built with Scrapy at its core. There are a small number of spiders that are causing us problems and we would like to find an expert to work on these.

1. Avoid bot detection

2. Make sure we are making best use of Selelnium or Headless Chrome to try to render pages that require javascript to render

There are currently 10 spiders that require work as per above, however there will be more work like this in the future.

Python

Scrapy

Kubernetes

Helm

AWS

-- You will be requested to provide evidence of some of the most 'difficult' spiders you have built and how you may have gotten around specific bot protections employed by certain websites such as [login to view URL] less

Python 网页搜罗 软件构架 JavaScript 数据挖掘

项目ID: #20107447

关于项目

13个方案 远程项目 活跃的4 年前

有13名威客正在参与此工作的竞标,均价$443/小时

DevStar925

hi. how are you? nice to meet you. i have enough experience for scrapping more than 10 years. if you hire me i will provide good result for you. i will wait you chat. thanks

$500 USD 在7天内
(69条评论)
7.3
sky930320

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spide 更多

$500 USD 在7天内
(36条评论)
6.8
kkc264043kkc

can make Scrapy spider along with captcha solution. Want to know more about it. Can build large distributed scalable scraper. have done scraping of millions of products from Amazon eBay Walmart. hav done scraping of 更多

$777USD 在1天里
(55条评论)
6.1
maryumakhter5

Hey there! I can do any sort of data mining or web scraping that you need to be done in a reasonable amount of time. I have years of Python, HTML, CSS and JavaScript experience under my belt and am ready to apply it 更多

$250 USD 在7天内
(34条评论)
5.5
smsaurabhv

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHO 更多

$333 USD 在3天内
(98条评论)
5.8
Ioitsolutions

I did such a job crawling popular e-commerce shops sites for getting web pages and parsing their content into word, excel, access and text files. I have a set of great tools, which can automatically scan pages, parse a 更多

$250 USD 在17天内
(5条评论)
3.0
kulvir01

I am specialize in website design and development and are excited for the opportunity to work with you in accomplishing your goals. We have developed thousands of websites in many programming languages for clients all 更多

$250 USD 在15天内
(1条评论)
0.8
SpeedTailV

Dear, We have Data Scientists, Data Analysts, Developers, Business Intelligence Analysts, Engineers and Business Operators. We Have Highly Trained Professionals & Experienced Workforce, who provide Good Support and Ef 更多

$500 USD 在7天内
(1条评论)
0.9
ANRTech

Hello, I am interested in your job and can make automation bot upon your requirements. Doing Web Automation and Windows/Desktop Automation based tasks from five years. Offers Solution for Your Everyday Problems. Manua 更多

$500 USD 在7天内
(1条评论)
0.0