Scrape prices, compare, and output to spreadsheet

I have a php script that scrapes product prices from three website sources. After the data is scraped, I have to manually compare the prices to another website. I would like the following script, capable of running all the scraping in parallel, in either PhP or Python:

1) From a list of product ID numbers in my mysql data base, scrape three websites and gather the products that meet my criteria (I have the search URL's set up already, so the script only needs to index the product code and download the page). I would like the ability to set the number of parallel threads that are working.

2) Using the data in step 1, compare the selling prices to the maximum buying prices at a comparison website (the comparison site is fairly intuitive, though will require cookies to work with a script...I have some python code started that might help). The comparison site may ban my IP if I overload it with requests, so I would like the ability to specify how many threads, as well as specify just one thread with a delay.

3) Output the results to a csv file, with a few calculated values.

Taidot: PHP, Python, Tietojen kaavinta verkosta

Näytä lisää: scraping websites, websites prices, to the maximum, thread up, spreadsheet script, spreadsheet in website, search code php with data base, scraping websites with python, scraping prices from websites, buying sources, scrape spreadsheet python, web scraping comparing, site scraping pricing, sorting mailing list, python download file, download file python, csv spreadsheet, buying websites, buying and selling websites, buying and selling site, website scrape, website product scrape, spreadsheet 2, site scrape, scraping python

Tietoa työnantajasta:
( 13 arvostelua ) Millis, United States

Projektin tunnus: #474819

13 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön


I can offer my high quality web scraping services to you. Please contact if interested.

$400 USD 0 päivässä
(120 arvostelua)

We can help in your project, please check PMB to see our related experience.

$250 USD 4 päivässä
(246 arvostelua)

Dear Customer! This is my favourite kind of project and I have a lot of experience in this field. Please see PMB for examples of my previous work. Ready to start immidiately and finish within several hours. My bid is f Lisää

$100 USD 0 päivässä
(166 arvostelua)

Let us start.

$90 USD 4 päivässä
(56 arvostelua)

hello , please check pm

$75 USD 1 päivässä
(49 arvostelua)

Please see PM for more details.

$75 USD 2 päivässä
(34 arvostelua)

Hello. I had a similar project in the past. I am ready to start immediately. Thank you.

$100 USD 3 päivässä
(34 arvostelua)

please see pm, thanks

$120 USD 1 päivässä
(59 arvostelua)

Hi, I would use PHP for this.

$100 USD 4 päivässä
(18 arvostelua)

Hi, I am a freelance programmer with over 11 years experience in VBA, Excel, MS Office, Perl, PHP, Mysql and SQL. I am an expert web scraper and data automation. I hope you find my experience and bid agreeable Lisää

$100 USD 1 päivässä
(2 arvostelua)

Hey We are ProffCoders .... WE are a team having 5yr+ experienced programmers and system administrators ... WE can do it very cheap as 120$ within 2 day. WE are new here.. So lets start it ... Regard Lisää

$120 USD 2 päivässä
(4 arvostelua)

quite seasy with python

$60 USD 2 päivässä
(0 arvostelua)

Hello, I have done a similar scraping project with python in the past. I also have extensive experience with csv files and the csv library python has... I can get started on this immediately and should have it done wit Lisää

$55 USD 2 päivässä
(0 arvostelua)