I need a fast search engine crawler to crawl the web and find websites that fit the simple algorithym (I will assit the programmer with details) and store the --> web addresses <-- NOT CONTENT that fit the simple algorithym in a database or text file. The web crawler should have many threads and should be able to crawl many websites everyday. (When submitting your bid please specify the number of pages the crawler will do per day) I should also be able to specify if I want a specific page to be crawled. I need this ASAP so be specific in your bid times. Also, I will not pay until I am completely satisfied, every time I have prepaid I got ripped off.
Be detailed in your bid or I will ignore it.
--- DO NOT BID IF YOU CANNOT CREATE WHAT WE NEED ---
------ DO NOT BID IF WE HAVE PREVIOUSLY FIRED YOU ------
If you are good and can complete this project we will give you first chance on future projects.
We have the crawler's core ready for you, just need to have it customized to your needs.
If you want so see it in action, we can provide a link to the demo version, not polished to your needs yet.
If you have more data about the project please make it available and feel free to ask any questions that you may have.
Have a nice day !