Price Grapper Crawler on mutli sites

Project Detail

We need to crawl few information from 8 sites: (we can pm to you if you request)

Part 1:


We need to store the following information from the 8 sites:

1. list pric

2. special price (if any)

3. sku / item code

4. product id (if any)

5. product title

6. product weight (if any)

Part 2:


We need a script which can auto pair up the product so that it can be used to compare.

since different site should have different product id for the same product.

basically, you can only use the product SKU / code or the product title to compare it.

Or you should let us define the rule, so that it can be config the pair up rule by ourself.

If it can't be auto pair up, we need a php page so that we can pair them up manually.

Pay attention:


All the product price should be in USD.

We care the "auto pair" script, if we got 5000 items from each site. and we need to pair them up manually for the 90% of the item... it is useless for us.

The script must be able to run in cron job weekly, so that we can update the price automatically.

After crawl the product, it is needed to update the mysql LOG so that we can check which NEW product is added and which product price is changed.

The script must be made as "module", so that in case we need to add more crawl site in the future.

we can simply add that site crawl function or module file. that your script will able to auto load it. and run it.

We allow this project to be done within 10 days. (included holiday)

Our Sever:


Redhat Linux, Apache 2.x, php 5.3.x



We will ecrow 50% of the payment once you are accepted to do this project.

you need to send us the code to test on our server or you can show us in your server.

Once we got your working code (at least 90% work), we will escrow another 50% to you.

The payment will be released to you if any only if after we TESTED and WORKED without problem in our server.

Normally the test takes about 1-2 days, it depends on how fast is your script can crawl.

it don't makes send s for us to test for 1 day if your script need 10 days to crawl, right?

Bonus will be given if your script is fast, clean and well communication.

normally we pay extra 10%-20% depends on your work.

Deadline is super important for us, if we can't finish it in the period you stated.

We have the right to cancel this project and you CANNOT argue on that.

If you DO NOT agree or DO NOT understand what we said, please DO NOT bid this project.

Taidot: PHP

Näytä lisää: will price, use case module, server load test, redhat linux price, price file, pric, php price project, pay usd by escrow, payment module escrow, no problem part 1, job sites in us, job define, future care, escrow price, ecrow payment, define send, define job, code sites, case escrow, product price crawler, product crawler, what is a crawler, job price, it job sites, linux price list

Tietoa työnantajasta:
( 23 arvostelua ) HK, Hong Kong

Projektin tunnus: #479469