Suljettu

Scraper for third party ASP/PHP database on internet site

I need someone familiar with ASP and PHP to direct me towards a solution (there is likely to be some software out there, I just can't find it) which will allow me to scrape (i.e. batch processing or automatic queries) records from a public database sitting on a website. One of several examples I could give: see [url removed, login to view]

This is a Spanish government website which lists all insurance agents in Spain, so that members of the public can query the website to determine if a particular agent is legitimate. Now I need to download the whole database for some analysis I am doing on the industry there. If you leave all fields blank and click on the left hand grey shaded button "Buscar" you will see there are about 99,600 records in there, and they are returned in groups of 10 with hyperlinks to the full record. Obviously I could sit there for three years and download the lot one by one. But is there a way to automate this, to throw all the records into an html or txt file so that it can be processed and pulled into Excel (clean formatting is not important - I can clean it up). IMPORTANT NOTE: this particular website does NOT return individual URLs with each query - if it did I could use any number of website downloaders out there to do this, but the fact that individual URLs are not returned makes it a problem for me and I haven't worked out a way around it. There are several other websites where I have the same problem - ASP or PHP databases which allow querying by forms.

What I am looking for is for someone simply TO REFER ME TO A PARTICULAR TOOL out there that will solve the problem. If the solution requires some special programming then I will set that up as a separate project.

Taidot: ASP, Javascript, Tietojen kaavinta verkosta

Näytä lisää: programming need website, websites programming, website programming solve, tool programming, tool php programming, php programming problem set, not legitimate, javascript programming software download, formatting websites, examples databases, databases examples, database website software, automatic programming website, third party asp, number spanish, php database programming, third, the party, php programming download, meh, excel solution return, e government, database javascript, excel project use database, project html insurance

About the Employer:
( 0 reviews ) Malvern East, Australia

Projektin tunnus: #479017

4 freelanceria on tarjonnut keskimäärin 118 $ tähän työhön

tirthsoft

Hi, Please check PMB.

100 $ USD 10 päivässä
(3 arvostelua)
3.5
Olympus9000

Hello I can write this to run from your pc desktop see my pm.

200 $ USD 2 päivässä
(0 arvostelua)
0.0
Siharat

Please check your PM

100 $ USD 3 päivässä
(0 arvostelua)
0.0
duy2000

Hello, nice to see your project post here, i understand that you want to have a software but i can write for you a simple script and you can parse all into some readable format. You can give me more details through PM Lisää

70 $ USD 2 päivässä
(0 arvostelua)
0.0