Need to detect and crawl non responsive websites registered through internet. Is it possible?
4 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön
As discussed - to develop web crawler from DNS root zone to determine website up/down/etc Will require server environment provided by you plus access to a WHOIS lookup account/API
Sure it's possible, if you were talking about detecting the open/close status of the standard http ports of a web site of giving dns name. If you meant another scenario, a specific description with details is needed.
Worked in projects like website crawling and data extraction. Having good experience in crawling websites. Tools used : Java , JUNIT for extraction code.