Data Scrape (17) diffrent websites - Build custom program
这项目被授予 Khurramz ，费用为$375 USD。为像这样的项目获取免费报价
项目预算$250 - $750 USD
Design & function of program:
1.) There will be a "Start Date" field & "End Date" field next to each county name. These fields will determine the date to insert on the (17) websites before making a search. Most website only let you search a "90 Day" max range. So what we need to do, is if the start date says "01/01/2001" and end date says "04/01/2001" we need to first scrape the 90 days so scrape untill "03/01/2001" then the program will search the next 90-day date range and stop once the "End date" has been made.
*Note: There will be option on top of program to set all (17) website “Start” & “End” Dates.
2.) Next, we need to add (3) buttons next to each county name for what data type we want to scrape. The options are "DEED, MTG, LPF / Foreclosures".
*Note: There will be an option on the top of the program to search “All available data”. This will automatically select what buttons/boxes data is available for that county. Availability of data is in the excel sheet that’s attached.
3.) The program will download ALL available fields that are shown. All images will also be downloaded such as DEED or Mortgage images.
4.) The output file structure will look like COUNTY/START-DATE-END-DATE/DEEDS or COUNTY/START-DATE-END-DATE /MTG or COUNTY/START-DATE-END-DATE/LPF Example: Atlantic/10-11-2016-12-11-2016/MTG.
BEFORE YOU BID: The URL’s of the websites that need to be scraped are in the excel document attached. Please ensure you can scrape ALL of these websites and not just one as a lot of them are completely different sites. ONLY freelancers with much reviews and experience will be awarded.
- The New York Times
- Wall Street Journal
- Times Online