Web Scraping Application of Big Box store 550+ Locations

Read from a database that would include store_id, zip_code, Product_id, the proceed to a big box website and retrieve current price, and quantity available. This information is then stored back into a database of Date/Time of pull, product_id, Store_id, qty available.

Please be aware this will pull from around 550 stores, and 4 products. This information will be pulled every hour. This program must be able to run for weeks without intervention and be able to handle this volume of hits to their website without interuption. We have upload the image of the database diagram. The website is located on the database diagram as well.


1.) You will need to bid your exact cost and timeframe on the proposal.

2.) Look at the Database Diagram attached and follow direction above "READ HERE"

3.) If Attention: is not stated on the proposal, you will be disqualified.

4.) It can be done in python or C#, if you propose something else it must be approved prior.

We are USA Based and operate on the EST Timezone, M-F 9:30am-6:00pm.

Taidot: Tietojen kaavinta verkosta, MySQL, tiedonlouhinta, Python, C# -ohjelmointi

Projektin tunnus: #23958894