Clone the site:
[url removed, login to view] <-- type in reverse order
We need to save ALL the product information to the MySQL DB.
Table will be given by us.
Script is written by PHP.
The product image (gallery) need to be stored in local file system.
NOT the db.
The image in products description, also need to be store in local file system.
The image path, image file name, need to be auto rename according to our rule.
The crawler should run to grap the TEXT first.
then grap the IMAGE (query from the local db), then save it specific folder as we stated.
Simple form UI is needed, it will allow us to crawl AT LEAST the following ways:
1. Grap the Product Data only.
2. Grap the Product Image only.
3. Grap the Product Data and Image at the same time.
4. Overwrite or Skip the existing Record.
5. Grap the product by using Category.
6. Grap the product by input the Product URL (grap one product only)
7. Grap the product by input a product ID range, say product ID 1-999
8. Can grap from the LAST stopping point. so that we don't need to regrap from zero.
9. It can allow us to run in cron job.
Text is stored in UTF-8 in Mysql DB 5.x version.
More detail will be given, just ask if you really want to do this.
We need EFFICIENT code, low memory and your script should NOT have timeout problem. (it is the min. technique you need to have, if you can't handle this, we are sorry we won't choose you)
For all interest parties, please show us your WORKING previous crawler job.
As we have too many bad experience, some code is not working at all.
some is working too slow, and lots of lots other problem.
We will escrow / milestone 50% of the payment once your offer is accepted.
another 50% will be paid when you show your working code in your server.
or you don't have server, we can test in our local VMWare.
We pay if and only if your code is working without any problem.
We do NOT accept any delay, please bid your job included holiday.
We are tired to deal with different holidays in different countries.
We are good company and offer at least 2-3 crawler project per month.
you can check our record. and hope you understand, do better, we will much more business to you.
PM your working crawler to us, or send your previous code to us.
For all PM without the working example will be ignored.