Completely scrape, spider an ecommerce site for inventory using python
$250-750 USD
货到付款
You are asked to create a python spidering program that downloads every product from a popular ecommerce site, returning a map of 9-12 bits of information about each product (product name, model number, cost, possible shipping cost, etc)
the project will be broken up in to 3 parts.
1.) method 1 will create a list of every bottom url listings page in the webpage hierarchy (the page where they list all products of a given type)
2.) method 2 scrape this bottom listings page (passed in via url address), and will scrape all individual item urls, including those found on the 'next' pages, if multiple ones are present for the listings page. this method will return the array of individual listings urls
3.) a method that takes in an individual listings url, and return the map with the relevant product information.
please specify additional packages needed before beginning work.
项目ID： #2659059
关于项目
有5名威客正在参与此工作的竞标，均价$370/小时
This can be done. It'll be more efficient if use regular expression. I've already written utility classes to scrap data from web page. If it's necessary to login on page it's possible.
