1. a PHP script that can scrape a website,
2. parse the sections I identify (see attached JPG image) and
3. insert them into MYSQL (red circled data goes into one table, blue circled data goes into the other)
- I have a skeleton php script written with general instructions and provided a sample URL to use as a test case.
- I have made the 2 mysql tables necessary and put test case data inside them.
The script must be fast; but be sensitive to the site you are scraping from (be friendly).
a) Pausing for a random number of seconds between 1 and 5 before scraping
b) Changing the browser headers before scraping (mozilla to IE,to opera, etc.)
c) use a http proxy (proxify, etc.)
I need it in 24 hours. I will provide sample data to those who PM me.
12 freelanceria on tarjonnut keskimäärin 126 $ tähän työhön
We can do your job with a high quality and looks. I own my own company webcore solution and I have many good developers along with me. I am ready to get this project from you .. Please check the PMB for the details