I need a fast search engine crawler to crawl the web and find websites that fit the simple algorithym (I will assit the programmer with details) and store the --> web addresses <-- NOT CONTENT that fit the simple algorithym in a database or text file. The web crawler should have many threads and should be able to crawl many websites everyday. (When submitting your bid please specify the number of pages the crawler will do per day) I should also be able to specify if I want a specific page to be crawled. I need this ASAP so be specific in your bid times. Also, I will not pay until I am completely satisfied, every time I have prepaid I got ripped off.
Be detailed in your bid or I will ignore it.
--- DO NOT BID IF YOU CANNOT CREATE WHAT WE NEED ---
------ DO NOT BID IF WE HAVE PREVIOUSLY FIRED YOU ------
If you are good and can complete this project we will give you first chance on future projects.