Completed

Need web spider scraping program written for the following username DFUSER8493

I need a web scraper written for the .xlsx file in the following directory:

[login to view URL]

The latest .xlsx file within that directory will need to be downloaded.

The name of the file is subject to change daily and will need to be identified by the latest .xlsx extension.

All information needed is available on the main page. The number of rows will vary.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in the "Origin City*" column (column B)

origin_state --> data located in the "ST" column located after the origin city column (column C)

ship_date --> data located in the "P/U Date" column (column A), change to the YYYY-MM-DD format

destination_city --> data located in the "Dest. City" column (column D)

destination_state --> data located in the "ST" column located after the dest. city column (column E)

receive_date --> leave blank

trailer_type --> data located in the "Eq. Type" column (column F)

load_size --> data located in the "Full/LTL' column (column G)

weight --> data located in the "Weight" column, add three zeros to the end of the

data if there are only 2 numbers (ie. 48 = 48000) (column O)

length --> data located in the "Length" column (column N)

width --> leave blank

height --> leave blank

trip_miles --> data located in the "Miles" column (column H)

pay_rate --> data located in the "Rate" column (column M)

contact_phone --> leave blank

contact_name --> add data from "Dispatcher" and "Ext." columns (columns J & K)

tarp_required --> leave blank

comment --> data located in the "Special Req." column (column L)

load_number --> leave blank

commodity --> data located in the "Commodity" column (column I)

The first line of the output should contain all of the column headers.

Any field that contains no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specific what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Taidot: Linux, Perl, Tietojen kaavinta verkosta

Näytä lisää: need web master, need web designer landing page, write web spider, how to scrape a website, web scraper tutorial, web scraping for beginners, intro to web scraping, how to build a web scraper, learning web scraping, web scraping medium, web scraping examples, python, linux, web scraping, perl, clickbank need web site, web spider development, need web site, web spider source, web spider crawling website robot vbnet

Tietoa työnantajasta:
( 62 arvostelua ) Chillicothe, United States

Projektin tunnus: #17453040

Myönnetty käyttäjälle:

gangabass

I can provide you same Perl scraping script as before: WWW::Mechanize, HTML::TreeBuilder::LibXML, Text::CSV_XS etc.

$88 USD 1 päivässä
(401 Arvostelua)
7.2

11 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön

schoudhary1553

raccoon Hello, I can help with you in your project scraping program. I have more than 5 years of experience in Linux, Perl, Web Scraping. We have worked on several similar projects before! We have worked on Lisää

$250 USD 3 päivässä
(13 arvostelua)
5.6
yongjin818

"raccoon" Dear I am an expert in web scraping. In before, I developed 400+ spiders using scrapy, php, selenium. For example, I scraped data for Many products informations from these sites(ex: ebay, amazon, welivv, bo Lisää

$155 USD 3 päivässä
(39 arvostelua)
5.3
adampohp79

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, perl, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, Lisää

$300 USD 3 päivässä
(11 arvostelua)
4.7
$77 USD 5 päivässä
(18 arvostelua)
4.9
SidhuDN

"raccoon" Dear Sir/Ma'am, I am ready to scrap web data. If you want, then I am able to start your work right now and give you the task within 2-3 days Without wasting your time I want to make a sample, Please a Lisää

$150 USD 3 päivässä
(6 arvostelua)
4.1
Bluesky122

RACCOON ⭐⭐⭐⭐⭐Please See My Profile⭐⭐⭐⭐⭐ Hi. I see your requirement and bid here. I have some idea about your project. first.I will make admin page to manage scraping. in there,some button will [login to view URL] you click s Lisää

$150 USD 3 päivässä
(2 arvostelua)
3.4
onedirecttech

Hi I hope you are doing good. You said to mention "raccoon". I have 12 years of experience in scripting in Perl and Shell script. There several Perl modules for reading spreadsheet using which I can use. I can do som Lisää

$277 USD 20 päivässä
(1 arvostelu)
0.8
$35 USD 3 päivässä
(1 arvostelu)
0.3
EliteTeam7

Hello, how are you ? I'm very interested in your project. I'm really web scraping expert using php, python and C# etc. i can show you several packages such as selenium, scraper etc. I can show you my good s Lisää

$155 USD 3 päivässä
(0 arvostelua)
0.0
vinothsridhar

raccoon I'm going to use headless chrome with was lambda function

$111 USD 2 päivässä
(0 arvostelua)
0.0