Peruttu

Program that pulls ALL links from a website

I am in need of a simple script/program that will copy ALL internal and external links from a website.

The script must not copy relative links, they should all be full links that could be copied into an address bar and work. (therefore it also should not abbreviate or shorten the links with … or any other foreign text)

Other criteria:

-Links to be output into an Excel file named after the domain of the website (.xlsx preferred but other Excel formats acceptable)

-Script/program must be highly reliable. Many websites have upwards of 10,000 to 50,000 internal and external links (however I will NOT be copying giants like Wikipedia or ebay)

-Due to the nature of redirecting links, redirects are not expected to copy the link being redirected

-If the Excel file can be automatically filtered of duplicates and sorted by name (ie column A sorted A>Z) I would like that. However if this is a significant burden on the script, I DO NOT want this because I do not want any possible variables that could slow the script or cause it to stop midway through a link scrape.

If you can create a script that is reasonably user friendly please post your bid.

Taidot: C-ohjelmointi, Excel, Ruby on Rails, Visual Basic, Tietojen kaavinta verkosta

Näytä lisää: wikipedia websites, xlsx, post links, external links, any program, all, program output, visual basic excel post, links post, relative simple, simple basic program, copy website domain name, copy automatically address bar, script cause slow, create excel file ebay, external internal, excel file program, copying program, copy links, excel slow, simple script cause, copy excel file ebay, ebay post links, basic script website, visual basic text column

About the Employer:
( 33 reviews ) Long Beach, United States

Projektin tunnus: #510583

11 freelanceria on tarjonnut keskimäärin 151 $ tähän työhön

srinichal

I can do the task

220 $ USD 2 päivässä
(110 arvostelua)
6.9
aruhat

Hello, Please have a look in PMB. Regards, Bhavik

250 $ USD 0 päivässä
(5 arvostelua)
6.0
marchent

Please check your PMB for details.

170 $ USD 6 päivässä
(38 arvostelua)
4.9
yashshell

===CHECK PM FOR ASSURED SOLUTION===

100 $ USD 3 päivässä
(1 arvostelu)
1.4
TipofIceberg

Please see your pmb. Regards.

100 $ USD 5 päivässä
(1 arvostelu)
1.0
IceReaven

hy there. please check PM for further details

200 $ USD 1 päivässä
(1 arvostelu)
0.0
yunhee

I can do this surely. I have many experiences with automated tools. Please leave me a PM if you are interested. Regards, Yunhee.

140 $ USD 2 päivässä
(0 arvostelua)
0.0
chankinwui

Hi, I have php script that can do that already. Very simple to use, just type the url and will return those your need predefined. Need a little bit more script to output a excel file. Regards, Jerry

50 $ USD 1 päivässä
(0 arvostelua)
0.0
grx3

I have your link scrapper script already created, we can just work out the details over PMB.

120 $ USD 8 päivässä
(0 arvostelua)
0.0
jarryhancy82

Hi, i am ready here to work. Thanks!

200 $ USD 5 päivässä
(1 arvostelu)
0.0
dobreswap

Read my PM. Dobre

115 $ USD 3 päivässä
(0 arvostelua)
0.0