Application needed to crawl & gather website data

We need a Windows application that we can leave running on a PC that will crawl a business directory on the web

We need to be able to specify limits (e.g. just gather .[url removed, login to view] domains, or just a specific category in the directory) and compile the following data.

It needs to log the page name, URL, and results for the following criteria....

1) Does the site use frames (y/n)

2) Does the page have a Doctype declaration (y/n) + what is it (html, xhtml, strict etc)

3) Does the page code validate (can integrate an open source validator)

4) What is the google page rank of the page (this is optional)

5) What was the directory category

6) A way of determining (looking for ideas) of whether it is built using CSS+divs, or tables for layout.

Please state as much detail as possible about how you will achieve this, how the logged data can be accessed (ideally as an exportable excel spreadsheet from the app.), and post examples if you have done similar things.

Taidot: C-ohjelmointi, Delphi, Visual Basic, Windows Desktop

Näytä lisää: website layout using css, spreadsheet to web application, open source visual basic 6, n. y. post, html to spreadsheet, html spreadsheet code, html 5 doctype, html 5 application examples, google spreadsheet web app, google spreadsheet rank, google spreadsheet html, google spreadsheet examples, excel to application, excel frames, directory page layout, basic website html code, application site web, application examples, what application, doctype html 5, validate excel, name ideas, metaphase, log post, google application

Tietoa työnantajasta:
( 39 arvostelua ) Surrey, United Kingdom

Projektin tunnus: #36992

11 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön


hi. please check pmb.

$300 USD 7 päivässä
(110 arvostelua)

We can do this for you with great pleasure and with excellent quality. Please, see PMB

$180 USD 3 päivässä
(38 arvostelua)

I can do it

$300 USD 5 päivässä
(3 arvostelua)

We offer an outstanding value added services and high degree of quality at very competitive prices. We assure quality work ,one month free suuport and 7/24 communication. ***** NOIRESOL *******Thanks*****Best Rega Lisää

$300 USD 15 päivässä
(2 arvostelua)

I am a gradute of Purdue University USA and have done my MSc in Software Systems from London. I have 10 years of experience in computing, 5 years VB, ASP and Java programming. Please see PMB for my detailed explanation Lisää

$300 USD 45 päivässä
(2 arvostelua)

Hi, I have nt actually worked on the exact specs that you have written down but on data extraction from a particular site. But can give it a try. Regards, Vibhu.

$300 USD 15 päivässä
(2 arvostelua)

Our bid is 289 $ for the whole project. Bid includes development , deployment and testing. we offer 30 days free support. We are ready start and send daily reports. we communicate through mail,messenger,phone and skype Lisää

$289 USD 10 päivässä
(2 arvostelua)

I have done projects like this in the past. See PM

$100 USD 10 päivässä
(5 arvostelua)

Can do this in Delphi. Will use MySQL 3 (will include it in installation procedure) server. Have xpirience ofpascal programming. Also can do this in php for UNIX. Already have page ranking module ... in php.

$100 USD 14 päivässä
(0 arvostelua)

I can do it. Program will be created using Delphy. Information can be saved in .csv files, or directly into MS Excel. I send a project in UML if needed, at first day.

$150 USD 7 päivässä
(0 arvostelua)

We are India based company into Web developement, Search engine optimization and BPO. We have done series of projects like dating, ecommerce solutions, image editors, gaming websites,professional websites and many mor Lisää

$300 USD 45 päivässä
(0 arvostelua)