Python scraping, scrapy expert for long term position.
$250-750 USD
货到付款
We have a highly customised scraping pipeline built with Scrapy at its core. There are a small number of spiders that are causing us problems and we would like to find an expert to work on these.
1. Avoid bot detection
2. Make sure we are making best use of Selelnium or Headless Chrome to try to render pages that require javascript to render
There are currently 10 spiders that require work as per above, however there will be more work like this in the future.
Python
Scrapy
Kubernetes
Helm
AWS
-- You will be requested to provide evidence of some of the most 'difficult' spiders you have built and how you may have gotten around specific bot protections employed by certain websites such as [login to view URL] less
项目ID: #20107447
关于项目
有13名威客正在参与此工作的竞标,均价$443/小时
hi. how are you? nice to meet you. i have enough experience for scrapping more than 10 years. if you hire me i will provide good result for you. i will wait you chat. thanks
can make Scrapy spider along with captcha solution. Want to know more about it. Can build large distributed scalable scraper. have done scraping of millions of products from Amazon eBay Walmart. hav done scraping of 更多
Hey there! I can do any sort of data mining or web scraping that you need to be done in a reasonable amount of time. I have years of Python, HTML, CSS and JavaScript experience under my belt and am ready to apply it 更多
Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHO 更多
I did such a job crawling popular e-commerce shops sites for getting web pages and parsing their content into word, excel, access and text files. I have a set of great tools, which can automatically scan pages, parse a 更多
Dear, We have Data Scientists, Data Analysts, Developers, Business Intelligence Analysts, Engineers and Business Operators. We Have Highly Trained Professionals & Experienced Workforce, who provide Good Support and Ef 更多