[login to view URL] should fetch multiple urls from mysql db(urls are manually product matched and updated in product_urls table) and crawl one by one based on competitor and product id and the parsed data should be inserted in competitors_price table.(done using native query but should be implemented using django models)
2. on completion scrapy should notify success/failure to backend server using post rest api.
3. scrapyd must be implemented over scrapy
4. django rest should call the scrapyd passing competitorID and productID as parameters.