I want to build a web crawler to monitor companies. I have a list of company names with basic information on the company including the company website.
With this information I want to go on websites such as:
- Google News
- Company Website
- others (TBD)
From these websites I need to retrieve information on the company.
The script should be able to handle thousands of companies at the same time which are updated on a regular basis (each week). Since there will be a lot of crawling on the same site, blacklisting should absolutely be avoided.
Further details can be discussed in detail.
25 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön
Hello Dear! I have checked your project carefully and think I can do your job. I have high skills in web scraping. If you share me more details, I can start work. Thanks.
Hi, I have a great experience in writing scrapers (more than 70 for such web sites as [login to view URL] or [login to view URL]). Сan complete your project quickly, efficiently and qualitatively. Regards.