I need about 1500 pages of data scraped from a website, probably with an automated tool to put this into a SQL database or an excel spreadsheet.
This public government website has four database-generated pages. For each, the last number in the URL needs to be incremented by one to see the next page.
The four pages are:
1. 25 Region pages (html text data, one big field)
2. 600 Facility contact pages (4+ fields that links to vendors))
3. 600 Facility data pages (about 50 fields in a table)
4. 350 Vendor contacts (name, address, phone, contacts)
This is a very straight forward scrape. The only tricky part is that a Facility Contact page could have more than one vendor link under a particular category.
Please provide an estimated bid and tell me which tool you use, and I will provide you with the links so that you can look at the pages and confirm your bid.