I need an automated web crawler that reads product information from retail store websites that sell apparel, shoes, handbags, and accessories, in particular. Specifically, it would pull information about the preceding products on sale from each site.
I want this to be similar in layout and functionality to [url removed, login to view] There will be 50 sites to crawl. The website has been created and is already online. It would just be a matter of creating and incorporating this crawler into the website. Thanks