Hey guys I would like to create a web spider are crawler, To fetch all the information from all sites etc in relation to specific [url removed, login to view] will Grab the name of the company and contact information. Last but not least I want the program to remove duplication from day to day and of course provide this program in a presentable manner store data in some type of free address book.
I really don't want to reinvent the wheel here and I want to keep the budget low. So I rather use already existing technologies.
I have 2 different crawler designs I need to incorporate.
If this project is of interest email and lets get started
have several more project after this