Im working on a web scraping application that scrapes a specific auction page.
The concept seems to work, but i need help cleaning the code, and finish the application.
The application is intended to check if the auction has ended, if it hasn't, place the auction in a pending "job" list in a table. Once the auction has ended, the auction is scraped from bids, ending price, seller name and so on. And the previous pending "job" is removed. The scraping script has to be able to be invoked by a cron job.
I have a bitbucket repo for the project, so please, be sure you have an account.