Robot Clone Crawler a website Product information to sql

Clone the site:

[login to view URL] <-- type in reverse order

We need to save ALL the product information to the MySQL DB.

Table will be given by us.

Script is written by PHP.

The product image (gallery) need to be stored in local file system.

NOT the db.

The image in products description, also need to be store in local file system.

The image path, image file name, need to be auto rename according to our rule.

The crawler should run to grap the TEXT first.

then grap the IMAGE (query from the local db), then save it specific folder as we stated.

Simple form UI is needed, it will allow us to crawl AT LEAST the following ways:

1. Grap the Product Data only.

2. Grap the Product Image only.

3. Grap the Product Data and Image at the same time.

4. Overwrite or Skip the existing Record.

5. Grap the product by using Category.

6. Grap the product by input the Product URL (grap one product only)

7. Grap the product by input a product ID range, say product ID 1-999

8. Can grap from the LAST stopping point. so that we don't need to regrap from zero.

9. It can allow us to run in cron job.

Text is stored in UTF-8 in Mysql DB 5.x version.

More detail will be given, just ask if you really want to do this.

We need EFFICIENT code, low memory and your script should NOT have timeout problem. (it is the min. technique you need to have, if you can't handle this, we are sorry we won't choose you)

For all interest parties, please show us your WORKING previous crawler job.

As we have too many bad experience, some code is not working at all.

some is working too slow, and lots of lots other problem.


We will escrow / milestone 50% of the payment once your offer is accepted.

another 50% will be paid when you show your working code in your server.

or you don't have server, we can test in our local VMWare.

We pay if and only if your code is working without any problem.

We do NOT accept any delay, please bid your job included holiday.

We are tired to deal with different holidays in different countries.

We are good company and offer at least 2-3 crawler project per month.

you can check our record. and hope you understand, do better, we will much more business to you.

PM your working crawler to us, or send your previous code to us.

For all PM without the working example will be ignored.

Taidot: PHP

Näytä lisää: working at vmware, website business information, robot name, range query, problem website, name the robot, name that robot, name of the robot, name for a robot, min range, is escrow a one time payment, handle escrow payment, escrow website script, escrow milestone, code 999, c# moc, check url website, business description of the product, auto payment escrow company, a grap, accept payment code escrow, script clone crawler, vmware job, accept a job offer, db escrow

Tietoa työnantajasta:
( 23 arvostelua ) HK, Hong Kong

Projektin tunnus: #486810

4 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön


Please view PMB

$250 USD 0 päivässä
(59 arvostelua)

i can do the job

$150 USD 3 päivässä
(128 arvostelua)

Hi,please check PM.

$200 USD 3 päivässä
(4 arvostelua)

IndiaWisdom is a web development company located in New Delhi,India. Our success is determined by how successfully we meet our client needs. Our goal is to serve our client and exceed their expectations, thereby streng Lisää

$150 USD 3 päivässä
(0 arvostelua)