We have a 3 spiders built in Python using Scrapy that run on a Google Compute Virtual Machine (on Debian) on Google Cloud Platform. Currently, as soon as the srapers finish, they restart and run again.
We need to add the ability for them to run at intervals (every 15 minutes, for example, or every hour). This interval needs to be something we can modify later if we want to.
We also need to add the ability for them to not run during certain hours (from 12 AM - 6 AM, for example). These hours need to be something we can change later if we want to.
Hi there! It could be built in the same python script without using bash or any other conf. If you're interested message me and we can do a try with that! Good luck!
15 freelanceria on tarjonnut keskimäärin 121$ tähän työhön
Hello sir We have 2+ years of experience on scheduling and reporting task. We assure you to deliver you the requirements on or before time with full satisfaction.
Hello, I can do this job and provide good interface to you to change scheduling whenever you want. We can descuss details if you want. Regards, Andranik