I am launching a Job Board aggregator (Yet, another one!), I am looking for someone that can support me on developing and maintain the web crawlers.
I already wrote some crawlers.
It exists a mono repo with three folders (Indexer, Crawler and Checker).
Each crawler is split into three files:
- "Indexer" to retrieve the links to crawl
- "Crawler" to scrape the data that I want to scrape
- "Checker" to check if that URL is still available
- PHP 7.3
I can share the private repo with who is interested to understand the work to do.
I am looking to launch several countries. I would like to have a bid for a single crawler in order to understand how many crawlers I can let you develop for each country.
Budget for each crawler: 15€
The request is to develop at least 10-15 crawler for each country: 150€-225€. I want to launch in at least 5 countries: 1500€-2250€