I need to scrape data from 70-80 websites which provides the same type of data about the same products. Targeted data types are – links, text and numeric. After scraping I need to rearrange, sorting and recalculate all data before a show to my website. Targeted websites add/change/update their data around 1-2 times per hour. So, I need those scrapers run/scrape automatically 1-2 times per hour.
Similar data found on multiple sites should be overwritten/skip/updated while scraping. Similar numeric data should be overwritten/skip/updated or replaced by higher/lower value while scraping. Some data should be overwritten/skip/updated by early/latest date and time.
There are some custom calculators are present on targeted websites. If those calculators can’t be scraped then those calculators have to be built with collected numeric data.
An admin panel needs to add/modify/delete data manually. Need to start/stop scrapers manually. Need to show the scraping reports. Need to control/modify banners on the website.
If you are only expert in scraping/programming, but not in website design/building you’re also welcome to bid in this project.
I need a website designed to show all these scraped data. The design of my website has to be very different than the targeted websites. Need clean and SEO friendly codes/links with full on-page SEO. Need to add payment API integrated to my website. Need some banners spaces on website and banners should be added to the website automatically after payment is done.
Payments will be made by 2 parts. I’ll create a milestone for scraping jobs. I have a simple website where you can show or test the outputs. Or you can build a simple website to test/show the scraped data.
Once the scraping/arranging/sorting/calculations are done successfully, I’ll create another milestone for the website design/functions.
Both milestones will be released after scraping and the website has done. No milestones will be released until the work is 100% complete. I’ll take 24-72 hours to check everything carefully and the milestone will be released then.
** MOST IMPORTANT: You must have to complete the project on the timeframe which will be discussed before awarding the project to you. Once the timeframe is over, the contract may get canceled and milestone payments will be canceled without any notice.
Thank you for reading the full details.
26 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön
Greetings, I am an experienced scrapper and have done similar projects in the past. Same can be verified by my profile. Let me allow to assist you. Thanks
~~~~~~~~~~~~Hi Dear I have much experience with Python Django, selenium, Web Scrapy, software architecture and so on. Please touch me. I will provide good service for you. Regards.