I am looking for someone to develop a price comparison website in Django using Scrapy (or something better) & Selenium - code must be documented in English. It should allow to crawl a "variable" number of separate sites (using a number of "spiders") that can pull out product details such as Product ID, Title, Price, Vendor, Description, Image, URL and Stock Position etc. This information should then be placed in a PostgrSQL database to be displayed using Web2py/Django. There should also be a way of the URL to the products be changed to affiliate links.
a) The Products Table in the server database should be automatically populated by the scraper. The required fields are Product ID, Title, Price, Vendor, Stock Position, Payment Options, Delivery Time
b) Easy extensibility to add more functionality in future.
c) Posibility to scrape indefinite number of ecommerce sites and easy adding new stores
e) Primary URLs to be saved with the date of last successful scraping, to enable scheduling of periodic repeat scrapings so that the prices of the products are always up to date.
f) While executing scraping, only those fields that have changed since last scrape are to be extracted and the original table entry for the product to be "updated", as required. In case of new products, the details to be "inserted" as a new row in the Products Table.
g) The website should be very fast to provide the best user experience
h) URL to the comparison products within the website to be changed to affiliate links when available.
i) Posibility of adding reviews and rating for each product and each store, and user accounts for example for favourite product lists etc.
j) Website should have design similar to ecommerce website for example something like Aliexpress with carousel, fatured products and advertisement features, and also fully customizable.
k) It should count all the redirections to the external stores and provide full statistics of the usage of the site by user, store etc.
l) It should list all the compared prices from different stores from the lowest to the highest but the first few could be choosen manually from featured stores even if they are higher than other prices
m) Categories and subcategories view should have filters on the left side so the user can easily filter out the products he wants. When needed new categories could be added.
n) Every store should have its separate page with different information as for example recent rates and reviews, brands sold etc.
o) Website should be also mobile friendly
if you have examples of previous work please share them. Additionally if you have advice on the a better architecture/solution I am open to ideas.
23 freelanceria on tarjonnut keskimäärin $557 tähän työhön
Hi! I am a web developer and Python expert. I can start work right now and successfully deliver final result to you. I can deliver your project in shortest time and successfully. Thanks.
Hi I am interested in working on this project with you but We need to discuss more details. Lets discuss and finalize all details and milestones for the project. thanks