Suljettu

Scrape prices, compare, and output to spreadsheet

I have a php script that scrapes product prices from three website sources. After the data is scraped, I have to manually compare the prices to another website. I would like the following script, capable of running all the scraping in parallel, in either PhP or Python:

1) From a list of product ID numbers in my mysql data base, scrape three websites and gather the products that meet my criteria (I have the search URL's set up already, so the script only needs to index the product code and download the page). I would like the ability to set the number of parallel threads that are working.

2) Using the data in step 1, compare the selling prices to the maximum buying prices at a comparison website (the comparison site is fairly intuitive, though will require cookies to work with a script...I have some python code started that might help). The comparison site may ban my IP if I overload it with requests, so I would like the ability to specify how many threads, as well as specify just one thread with a delay.

3) Output the results to a csv file, with a few calculated values.

Taidot: PHP, Python, Tietojen kaavinta verkosta

Näytä lisää: scraping websites, websites prices, to the maximum, thread up, spreadsheet script, spreadsheet in website, search code php with data base, scraping websites with python, scraping prices from websites, buying sources, scrape spreadsheet python, web scraping comparing, site scraping pricing, sorting mailing list, python download file, download file python, csv spreadsheet, buying websites, buying and selling websites, buying and selling site, website scrape, website product scrape, spreadsheet 2, site scrape, scraping python

About the Employer:
( 13 reviews ) Millis, United States

Projektin tunnus: #474819

13 freelanceria on tarjonnut keskimäärin 127 $ tähän työhön

soner

I can offer my high quality web scraping services to you. Please contact if interested.

400 $ USD 0 päivässä
(120 arvostelua)
8.0
SigmaVisual

We can help in your project, please check PMB to see our related experience.

250 $ USD 4 päivässä
(246 arvostelua)
7.9
zeke

Dear Customer! This is my favourite kind of project and I have a lot of experience in this field. Please see PMB for examples of my previous work. Ready to start immidiately and finish within several hours. My bid is f Lisää

100 $ USD 0 päivässä
(166 arvostelua)
6.9
webphpworld

Let us start.

90 $ USD 4 päivässä
(56 arvostelua)
6.4
dreamci

hello , please check pm

75 $ USD 1 päivässä
(49 arvostelua)
5.7
Scorpio1987

Please see PM for more details.

75 $ USD 2 päivässä
(34 arvostelua)
5.3
ClusterStudio

Hello. I had a similar project in the past. I am ready to start immediately. Thank you.

100 $ USD 3 päivässä
(34 arvostelua)
5.0
acer2004

please see pm, thanks

120 $ USD 1 päivässä
(59 arvostelua)
4.8
thepoet

Hi, I would use PHP for this.

100 $ USD 4 päivässä
(18 arvostelua)
4.1
NashTrump

Hi, I am a freelance programmer with over 11 years experience in VBA, Excel, MS Office, Perl, PHP, Mysql and SQL. I am an expert web scraper and data automation. I hope you find my experience and bid agreeable Lisää

100 $ USD 1 päivässä
(2 arvostelua)
3.5
ProffCode

Hey We are ProffCoders .... WE are a team having 5yr+ experienced programmers and system administrators ... WE can do it very cheap as 120$ within 2 day. WE are new here.. So lets start it ... Regard Lisää

120 $ USD 2 päivässä
(4 arvostelua)
2.5
sinedone

quite seasy with python

60 $ USD 2 päivässä
(0 arvostelua)
0.0
svarozian

Hello, I have done a similar scraping project with python in the past. I also have extensive experience with csv files and the csv library python has... I can get started on this immediately and should have it done wit Lisää

55 $ USD 2 päivässä
(0 arvostelua)
0.0