Pull data by modifying our script in PERL/CGI
$250-750 USD
Maksettu toimituksen yhteydessä
We will provide 2 x webcrawler scripts in ‘PERL/CGI’ that need to be modified. These scripts are application scripts that run on cron to automatically download the csv files and pics. from pw protected online auctions websites where we enjoy memberships. Our target and purpose for this project is to find a professional team or a dedicated individual, who can make work these auctions' data through our website. Therefore you will modify the script to pull the data & pics. And integrate in MySQL, Please see details below.
Job Description :
1. You are required to modify my scripts and install on my server to run on cron in intervals, i.e; to download data ( mostly) by hourly basis during 0000Hrs.-0700Hrs. free time, and on 2- hourly basis during day-time. (A HTTP proxy will require for the safety precaution of our IP address.)
2. You will make some changes and enhance some features, in the search and display functions for this data on our website.
3. While, the data is almost similar but the name of the fields differ (20%) for the (two) websites from where data is pulled, we shall provide sample of joining both in one (new) table in MySQL.
4. We need a fly to make users take advantage of saved data & search from our db for market-price evaluation from past bids.
5. Some design modification on index page & one inner page is desired because of this new feature.
6. Our present feature (addauction php script) will be converted to show display on website as stock; since the crawler will bring live data on daily basis.
Requirements :
• An Expert in PERL/CGI , PHP & MYSQL is pre-requisite.
• Create a new table for the values and have to make our present website features workable, such as members accounts and stock display etc.
• Data transfer is tremendous on daily basis. It should support all the features of the target sites and should also support continuous updates as they take place at the target sites, and automatically delete the previous data according to our disc capacity.
Conditions :
• We can provide you further details and full support (not from technical side since we have not made this perl crawler application).
• We can escrow 30% advance and will transfer it upon completion of first site crawler.
• 70% will be Escrowed immediately upon successful installation of first crawler.
• We would require support for about 6-months for as if there is any changes from target sites might affect our tables and or might the script need tuning to work properly.
• Russian language can be asset because some hints & notes for our application script are in Russian.
• All bids above USD$500 will be void bids.
Projektin tunnus: #237303
