Website Scraper and Import Tool

Dear Coders, IMPORTANT: Please do not use placeholder bids and respond only with specific questions about my project. If your bid exceeds our limit, then do not bid. We have a csv file containing several thousand tool model numbers. We want you to build a scraper that we can periodically use to scrape the individual URL for each product from 14 retailers and append the csv file with the URL's for each product. If the product is not available on one of the source sites after attempting various combinations for the product model, then simply skip. The 14 sites will be fixed but we'll need to be able to omit one or more of the retailer sites from collecting the data if necessary...a simple checkbox option next to the 14 retailers is all we'll require. That is...by default they are all checked and hence all scraped for the product URL however if one or more is unchecked, they will be excluded from the scraping process and hence results. You'll need to factor in how to prevent the scraper from being blocked. For this, we'll provide a set of proxies - we'll need to be able to either add a list proxies or add a URL for rotating proxies. I would also like you to build some functionality that reports or logs when proxies are failing. Preferably, you should be able to offer advice as to the most suitable proxy provider. Most importantly, do not build for one type of proxy but give options. It is important to note that some of the supplier sites below use CloudFlare making it difficult to scrape. You'll need to find a way around this. We've included a sample csv file with product examples. So far for testing purposes, I have provided a list of about 60 items. In the final csv, there will be many thousands of products to scrape. Your scraper must run fast. The structure of the input csv is as follows: Product Title, Model Number, Brand, Category, Sub-Category, Product Image The 14 retailers are listed here: 1) Total Tools - [login to view URL] 2) Just Tools - [login to view URL] 3) Vek Tools - [login to view URL] 4) Get Tools Direct - [login to view URL] 5) Power Tools Specialist - [login to view URL] 6) Bunnings - [login to view URL] 7) Discount Trader - [login to view URL] 8) Tool Mart - [login to view URL] 9) Melbourne Tools - [login to view URL] 10) Trade Tools - [login to view URL] 11) Australian Industrial Supplies - [login to view URL] 12) C L Tool Centre - [login to view URL] 13) Gasweld - [login to view URL] 14) Mitre 10 - [login to view URL] My suggestion is to use the model Number in the search bar of the retailers below to find a suitable match for the product. If you have a better solution please advise. Please be aware that should the first search for the item fail, you may need to use an alternate product number combination. For example, if you can't find D26500K-XE, then you should try D26500K(XE) or D26500KXE or something similar. It will be your job to determine the best way to find the products taking into consideration the unique way each site represents it's products. Next, you'll need to modify a price comparison plugin we have built to allow it to import this csv data into the database. We will provide access to a copy of the site for you to review the code after acceptance of the project. Time Frame: 2 weeks absolute maximum. Any questions, please advise. Simon