Authenticated website listings scraper & file downloaders

Suljettu Julkaistu 5 vuotta sitten Maksettu toimituksen yhteydessä
Suljettu Maksettu toimituksen yhteydessä

Looking for a Go developer to create a scraper for 3 websites:

1: login & download excel -> extract rows and send to DB

2: login & download csv -> send to DB

3: login & scrape listings (3 pages):

a) paginated listing page

b) listing admin page

c) listing public page

d) send to DB

Scraper should be 3 Go packages, one for each website. Each package should have:

a) an interface to start/stop

b) detect failure (connection & html format change)

c) configurable retry on connection fail (retry max X times, every Y seconds)

d) delay of X seconds between page requests

e) concurrent listing data export interface

The projects must be developed in the Go programming language.

Golang Tietojen kaavinta verkosta

Projektin tunnus: #17319885

Tietoa projektista

6 ehdotusta Etäprojekti Aktiivinen 5 vuotta sitten

6 freelanceria on tarjonnut keskimäärin $213 tähän työhön

mhmhz

Hi I propose to implement the 3 scrapers in C# (to make it multi-threading) Thanks

$300 USD 2 päivässä
(98 arvostelua)
7.6
bestit4u

Hi I am very,very interested in your project My name is Shan Bin and I'm a Chinese developer. I have 6 years of development experience such this projects. I am a highly skilled developer in C, C++, C#, Python, Java, Lisää

$155 USD 3 päivässä
(70 arvostelua)
6.8
kenavpatel

1) I am confident to extract the row in Excel and send to the DB 2) also can do CSV and send to DB. 3) 3 pages which you have mentioned will also get scrapped. it is easy for me And Scrapping will be done as you have Lisää

$200 USD 2 päivässä
(0 arvostelua)
0.0
akhileshgandhi

Hello There, I can develop a scraper for scraping data from different websites. Can also show some samples of your given task. I have extreme experience in Web Scraping. Have done a lot of work of Scrapping. I use Lisää

$248 USD 3 päivässä
(0 arvostelua)
0.0