The scope of the project is to modify an existing scarper which was made for another "Similar" website. You will have to change 3 topics:
1. Change scraper rules to fit the current website
2. Change scraper loop rules
3. Change scraper resume rules.
Here is an example of a page that needs to be parsed:
[login to view URL]
You should create a loop with running numbers. Here is an exmaple of one ID, you should find the minimum working number and keep running up until you get 1000 errors.
Example URL: [login to view URL]
The loop should run through sequences that start with the following letters: W,D,C (Please design the program in a way that it would be easy to add more letters)
Please note that the existing script is built for website with only one set of numbers. You have to add a check for the last ID with each on of the letters and resume from that point.
If you will run the attached script, please change the config file to your local SQL server and it will create the SQL server database for you. Please note that the self explenatory fields that are in the page should be parsed into the database.