i need a simple spider to research advertising links. i want to input my affiliate links into a db and have the spider crawl all my links.
i want all the urls that the spider encounters (301 redirects, 404s, .ico files, flv files, etc) captured. at the end of the run i want to be able to export all these urls into an excel file. (sorted and organized)
the script should have a simple admin screen where i can input single affiliate links or upload from a txt file. there could potentially be 50-100 links each run.