I am looking for someone who can code me a crawler. The crawler should scan 2 websites and store certain informations from this websites in some CSV files. The information that needs to be crawled is just normal text but is placed different on the 2 websites (nevertheless for one website it is always the same). The crawler should go through the sites and grab all that informations. It should be possible to select which one should be crawled. For each website the crawler should generate CSV files under the criterias i will give you. The crawler shouldn't generate duplicate entries.
The project was already posted once but was cancelled. The problem was that the content structure of the websites is not regular, missing some close html tags. So please only give your bid when you can adress that problem.
22 freelanceria on tarjonnut keskimäärin 142 € tähän työhön
I can do this with imacros for Firefox or create desktop BOT software with UBOT. I've already done similar projects. See examples in portfolio or on my website [url removed, login to view]