Peruttu

custom web crawler(repost)(repost)(repost)

I need a program which will look like a person surfing a social networking site.

The site is [url removed, login to view]

The software needs to log in to netlog, look for profiles using the explore profiles tool, and visit profile pages. Later I'll want it to auto-post stuff too, but for now, just surf without "doing" anything.

I'll need it to support:

1) Multiple logins (preferred these logins will be "surfing" in parallel, each on a different proxy server, but not required)

2) Proxy support (each logged-in session should use one proxy selected by random from a list). Only HTTP proxy support is needed, not VPN PPTP or anything fancy

3) For each account, I should be able to select search criteria. For now the criteria should include:

a) Country

b) Region

c) Age Range

d) Gender

e) Online-to-Offline ratio

4) There should be a way to tell the software how often a profile may be revisited (like 5 times each 2 weeks, means that the software won't visit a given profile more than 5 times in any 2 week period. That technically isn't good enough because I don't want it visiting 5 times in a row and then nothing for 2 weeks - no person should be visited back-to-back unless we're out of new profiles to look for)

There should be some visible status of what's happening at any given moment - updated at least every 30 seconds, but it shouldn't be dumping insane amounts of text at me 24/7 either :)

Does this sound like something you can do? I think it should be a pretty easy project - assuming well under 15 hours of work, but tell me if I'm wrong.

Taidot: tietojärjestelmäarkkitehtuuri

Näytä lisää: web search tool, web crawler architecture, web-crawler, row 44, online web crawler, architecture of web crawler, what is a crawler, online web proxy, vpn software, vpn site to site, text ratio, software to auto post, pptp vpn, d surf, server status tool, web proxy surfing, repost auto, proxy surfing, http proxy server list, program region

Tietoa työnantajasta:
( 66 arvostelua ) Walnut, United States

Projektin tunnus: #2711573