Peruttu

Price Grapper Crawler on 5 sites

We need to crawl few information from 5 sites: (we can pm to you if you request)

===========================

We need to crawl the products price from 5 sites.

some of the sites is very simple, as they have product ID in the URL.

e.g. [url removed, login to view]

so, you can do it very easily.

We only need to store

1. list price

2. special price (if any)

3. sku / item code

4. product id (if any)

5. product title

6. product weight (if any)

7. product URL

8. site ID, to indicate which site you store

9. product image, just the small listing image is fine.

10. any other field that you may need to store in order to let your program run, such as last crawl date, flag, hash, etc

All the data is stored in MySQL 5.x db. (the image file is store in local folder)

We use those data to compare the price (you DO NOT need to write this part, just store the data format as we request is enough),so, no need to store other information.

but if you think that storing other information, such as category is helpful, you can store it.

we don't mind.

Pay attention:

===========================

All the product price should be in USD.

The script must be able to run in cron job OR manually.

If the product is crawled before, update the exist record.

It should allow us to input a product URL or product ID range, so that we can crawl some product

manually. it is mainly use to fix some products which is timeout during crawl.

It should allow us to set which site to be crawl in the "web submit form", just like a normal web form.

The project must be written in module, so that we can add extra CRAWL site php file, say the 9th site:

[url removed, login to view] in the module/ folder.

then your script will auto load that file and we need to change nothing in the php files.

the auto crawl setting should be store in db, so, please give us a web form so that we can modify it.

such as when to crawl, which site to crawl

don't request us to do it in phpmyadmin. a normal end user don't know how to use phpmyadmin.

After crawl the product, it is needed to update the mysql LOG so that we can check which NEW product is added and which product price is changed.

We allow this project to be done within 10 days. (included holidays)

Our Sever:

===========================

Redhat Linux, Apache 2.x, php 5.3.x

Payment:

===========================

We will ecrow 50% of the payment once you are accepted to do this project.

you need to send us the code to test on our server or you can show us in your server.

Once we got your working code (at least 90% work), we will escrow another 50% to you.

The payment will be released to you if any only if after we TESTED and WORKED without problem in our server.

Normally the test takes about 1-2 days, it depends on how fast is your script can crawl.

it don't makes send s for us to test for 1 day if your script need 10 days to crawl, right?

Bonus will be given if your script is fast, clean and well communication.

normally we pay extra 10%-20% depends on your work.

Deadline is super important for us, if we can't finish it in the period you stated.

We have the right to cancel this project and you CANNOT argue on that.

If you DO NOT agree or DO NOT understand what we said, please DO NOT bid this project.

Taidot: PHP

Näytä lisää: working of web crawler, will price, submit to web crawler, small job sites, sites that pay you to write, server load test, redhat linux price, price file, php price project, payment module escrow, job web crawler, job sites in us, job listing sites, job flag, fix test request, fix it sites, fine products, escrow web sites, escrow price, escrow com small price, ecrow payment, do you have to pay to use escrow com, code sites, price grapper, php product crawler

About the Employer:
( 23 reviews ) HK, Hong Kong

Projektin tunnus: #499371

17 freelanceria on tarjonnut keskimäärin 274 $ tähän työhön

buraqtech

Check your PMB for details!!!

550 $ USD 15 päivässä
(86 arvostelua)
7.9
CrossBiz

Please view PMB

450 $ USD 10 päivässä
(60 arvostelua)
7.4
srinichal

waiting for more details

250 $ USD 5 päivässä
(96 arvostelua)
7.1
Sphinks

Hello sir. I can help you with this project. I've done this kind of projects before. Regards, Sphinks!

200 $ USD 3 päivässä
(88 arvostelua)
6.6
MAnkita

Hello,Please refer your [url removed, login to view] you.

250 $ USD 7 päivässä
(48 arvostelua)
6.4
EfficientDev

Hi. I just built such a price comparison application. I will need the 5 URLs you wish to scrape. Please check PM for details. Regards.

600 $ USD 7 päivässä
(29 arvostelua)
5.6
alhorro

Check PM please.

175 $ USD 5 päivässä
(14 arvostelua)
5.1
andreiandrei

Hi,please check PM.

250 $ USD 5 päivässä
(4 arvostelua)
4.8
ukshumi

Please check PM

190 $ USD 5 päivässä
(10 arvostelua)
3.7
radukeepwalking

Hi. I can help you with this project. I am sure i am the right person because i have a good experience in data grabbing from website. I will send you a pm with some of my projects.

150 $ USD 3 päivässä
(1 arvostelu)
3.1
jnanchak

Hi I am basically a perl programmer and like to scrape sites using perl. I can do it in php though but i think perl would be a better choice as it is fast. Please accept my bid Thanks

150 $ USD 25 päivässä
(5 arvostelua)
2.7
code7

Hi, Please check PM.

150 $ USD 1 päivässä
(6 arvostelua)
2.7
congruent

Lets start...................send the complete project requirement

250 $ USD 24 päivässä
(2 arvostelua)
5.5
nitinmohan08

Over 3 years of experience in PHP/MySQL. I believe I can do this. Looking forward to your response.

500 $ USD 10 päivässä
(0 arvostelua)
0.0
perfaction

lets do this asap

150 $ USD 3 päivässä
(0 arvostelua)
0.0
phpex

Please check PMB

180 $ USD 4 päivässä
(0 arvostelua)
0.0
pjcloud18

Hi we have years of experience and expertise in PHP. with our experienced and expert people we can assure you accurate,creative and timely results,according to your requirements.

210 $ USD 8 päivässä
(0 arvostelua)
0.0