There has been a project similar to this posted before, ([url removed, login to view] data extractor). I require an application that does the same - extracts [url removed, login to view] data and saves it as a MySQL DB or CSV file.
Fields required are as follows
- Company Name
- Address line 1
- Address line 2
- Website (if applicable)
- Email (if applicable)
- Date last updated from crawler.
- must be able to extract the data from the sponsored listings.
- Must be able to automatically or otherwise be able to extract the data from the continuing pages i.e 2, 3, 4 onwards to get the full data.
- save it all in a MySQL Database.