We need a scraper for KSL classifieds ([login to view URL]).
The scraper needs to use Puppeteer and Headless Chrome.
The scraper needs to be written in Python 3.
All requests need to be routed through Crawlera ([login to view URL]) in order to avoid getting banned. We already have a subscription and API keys for this.
The scraper needs to accept the following search / filter parameters:
listing posted timeframe
The scraper also needs to be able to run without any search parameters.
We already have a Google Cloud Platform Virtual Machine (Google Compute Engine Virtual Machine) Debian instance. This scraper needs to run on it.
We already have a MySQL 2nd Gen 5.7 instance running on Google Cloud Platform. The scraper needs to write all results to this database.
The scraper needs to store the following attributes about each individual listing in our MySQL database:
number of page views
number of favorites
The scraper needs to run on a schedule (every 15 minutes, for example). This schedule needs to be modifiable if we want to change it later.
We need the code. We will run the spider to scrape all listings and run continuously on our Google Compute Engine instance.
The scraper needs to update existing listings in the database when listing properties on [login to view URL] change. Example: a cell phone is posted for $400. The scraper finds the cell phone and stores it in the database. Two days later, the seller changes the price to $350. The scraper sees the ad again, sees that a listing attribute (the price) has changed, and updates the row in the database.
24 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön
Hello, This project is quite easy for me, but I got couple of questions to clear before we proceed [login to view URL] message me to have a quick chat.
Hello How are you i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your posting Xu Han
Hello I have checked your description and understood what you are seeking. I have good experiences for building scraping script. Anything you want, I can get the data needed. Please ping me. Regards