Create Scraper for [login to view URL] Classifieds Using Headless Chrome with Puppeteer in Python 3 -- 2

We need a scraper for KSL classifieds ([login to view URL]).

The scraper needs to use Puppeteer and Headless Chrome.

The scraper needs to be written in Python 3.

All requests need to be routed through Crawlera ([login to view URL]) in order to avoid getting banned. We already have a subscription and API keys for this.

The scraper needs to accept the following search / filter parameters:


min price

max price


seller type

listing posted timeframe

The scraper also needs to be able to run without any search parameters.

We already have a Google Cloud Platform Virtual Machine (Google Compute Engine Virtual Machine) Debian instance. This scraper needs to run on it.

We already have a MySQL 2nd Gen 5.7 instance running on Google Cloud Platform. The scraper needs to write all results to this database.

The scraper needs to store the following attributes about each individual listing in our MySQL database:



datetime posted




number of page views

number of favorites

listing number

The scraper needs to run on a schedule (every 15 minutes, for example). This schedule needs to be modifiable if we want to change it later.

We need the code. We will run the spider to scrape all listings and run continuously on our Google Compute Engine instance.

The scraper needs to update existing listings in the database when listing properties on [login to view URL] change. Example: a cell phone is posted for $400. The scraper finds the cell phone and stores it in the database. Two days later, the seller changes the price to $350. The scraper sees the ad again, sees that a listing attribute (the price) has changed, and updates the row in the database.

Taidot: Python, Linux, Tietojen kaavinta verkosta, tietojärjestelmäarkkitehtuuri, Google Cloud Platform

Näytä lisää: scrape google reviews puppeteer, puppeteer introduction, puppeteer and cheerio, puppeteer get data, web scraping with express and puppeteer, puppeteer medium, headless browser web scraping, puppeteer write to file, create seo friendly url website using php wordpress, create view dynamic web reports using itext, create simple java inventory program using arrays, create table columns csv file using php, create dynamic pdf files payslips using, need create report service web application using oracle, create progress bar file uploading using php, create web banner day care using flash, create file upload progress bar using jsp, create scraper, displaying com ports using, programing com port using

Tietoa työnantajasta:
( 0 arvostelua ) Brigham City, United States

Projektin tunnus: #20373155

Myönnetty käyttäjälle:


Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the Lisää

$174 USD 3 päivässä
(101 Arvostelua)

24 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön


Hello, This project is quite easy for me, but I got couple of questions to clear before we proceed [login to view URL] message me to have a quick chat.

$200 USD 2 päivässä
(75 arvostelua)

Hi, employer. I am a web scrapping and automation expert. Very familiar in PYTHON selenium and Node.js Puppeteer. I've read your proposals carefully and I think I can do it. Also, I can handle google sheet and Airtabl Lisää

$200 USD 3 päivässä
(35 arvostelua)

Hello How are you i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your posting Xu Han

$140 USD 7 päivässä
(56 arvostelua)

Hi Nice to meet you. I have enough experience in python script. Below the libraries are I used in past project. selenium, pandas, matplotlib, lxml, beautifulsoup, scipy, and other useful libraries. I have written some Lisää

$200 USD 7 päivässä
(76 arvostelua)

Hi, Client!! @$@$@$PLEASE CONTACT ME. I CAN DO IT WONDERFULLY.$@$@$@ ##% Your idea is attracted me to your world.%## I am Python expert. i have various skills. @example@ python selenium and beautiful soup, regular E Lisää

$140 USD 7 päivässä
(39 arvostelua)

Hello Sir, We are expert in data scrapping We are team of professional developers with having more than 7 year's experience in this field also I read your project description and We are interested in it but still we n Lisää

$250 USD 7 päivässä
(59 arvostelua)

Hello. I have good experience writing many scraping script with python3. I have checked your description and KSL websites in detail. I can implement headless chrome driver, search engine, Crawlera and insert/update th Lisää

$250 USD 7 päivässä
(36 arvostelua)

Dear Sir, I am interested in your project. I'm expert in web scrapping and web automation using selenium and jsoup, data management, data mining. I assure, I will do my best to work with you on your project to present Lisää

$200 USD 4 päivässä
(31 arvostelua)

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHO Lisää

$111 USD 3 päivässä
(62 arvostelua)

Hello! I am glad to place a bid on your project. I am good at Python and its scraping modules including selenium, scrappy, and so on. I have read your description and I can do your project perfectly. I can do your pro Lisää

$140 USD 7 päivässä
(17 arvostelua)

Hello! I am glad to place a bid on your project. I have read your description and I can do your project perfectly. I am good at Python and its scraping modules including selenium, scrapy, and so on. I can do your proj Lisää

$200 USD 7 päivässä
(12 arvostelua)

Hi ⭐⭐⭐I can finish in 1 day ⭐⭐⭐ I am an experienced and skillful Python and data entry and web scrapping expert. I have finished several websites scrapping with Python selenium or BeautifulSoup. I have rich experienc Lisää

$70 USD 1 päivässä
(26 arvostelua)

Hello I have checked your description and understood what you are seeking. I have good experiences for building scraping script. Anything you want, I can get the data needed. Please ping me. Regards

$200 USD 7 päivässä
(8 arvostelua)

Hi, How are you? I am very interest in your project. As I am a professional Python,Scraping Expert with great experience and skills, I am sure that I can help you I'm ready to start to work on your project right now. Lisää

$200 USD 7 päivässä
(7 arvostelua)

Hi , We have gone through your requirements and will make a code in python 3 to scrape [login to view URL] for product details using crawlera because of the proxy rotation as well using puppeter because the website is been loa Lisää

$250 USD 7 päivässä
(4 arvostelua)

I am a professional data scientist from Scotland, I am currently working with a financial firm scraping financial data from various sources. I have the relevant experience needed for this project. Lets discuss more whe Lisää

$250 USD 7 päivässä
(3 arvostelua)

"Hi. Please survey my reviews. I saw your description carefully and I am confident I can full fill your requirement. So I provide my skills in hopes of working with you. I am full-stack developer and I have 2+ years Lisää

$150 USD 1 päivässä
(4 arvostelua)

Hi, sir I have read your description carefully. I am interesting in your project. You can check in [login to view URL] "SUCCESS = Faster Speed + Loyal Quality + High Credit" This is my slogan on working with cli Lisää

$150 USD 3 päivässä
(5 arvostelua)

Hello dear hiring manager With my good experience in core python, I can scrape any website with the help of Scrapy and Selenium. till now I have scraped more than 200 websites which includes Linkedin, Facebook, Twitter Lisää

$200 USD 2 päivässä
(2 arvostelua)

Hello, sir Thank you for your job posting. I am really interested in your project and I can satisfy you with my result. I am an expert with web scraping with python and nightmarejs--using headless browser. Also i have Lisää

$150 USD 3 päivässä
(2 arvostelua)