Peruttu

Build a scraper in PHP using curl and regular expressions

I'm looking for a skilled developer with good experience and knowledge of curl and regular expressions. Please read the below explanation very carefully. I have many scrapers that need to be worked on because the website changed. It may in some cases be required to change the whole script. However you will receive the old script for reference. You will receive a weblogin which you can use to upload your script and to test your script in an easy and convenient way.

Please bid a price you ask per scraper. We can then later see how many scrapers you can do.

GENERAL:

- The scraper should scrape journey details(prices, departure times, etc..) from travel websites when a ONE-WAY trip is considered.

- The scraper has 2 basic functions: 1. Get the content cotaining travel information from the website. 2. Parse the data we need using regular expressions.

- The output will be in arrays. Each array contains information of a certain property of the travel such as price, departure time, departure date etc. Each array key MUST represent details for the same travel. For example $price[1] and $depdate[1] and $deptime[1] etc has to belong to the same travel.

IMPORTANT:

- Each array key MUST represent details for the same travel. For example $price[1] and $depdate[1] and $deptime[1] etc has to belong to the same travel.

- The size of all arrays must be equal.

- Check manually if the output of the script is accurate by using the website of the operator for different travels.

- This is the base file for making a script that scrapes a website

- Save the file using the name of the operator as: [url removed, login to view]

- When the scraper is finished test it for at least 20 combinations of input for $travelfrom and $travelto

- Check if the output is according to format and all scraped

- When you get a log-in to the website where you can tes the scraper make sure that the database input check was succesful

- The scraper should work for all available journeys from the website

- Use regular expressions for the data parsing.

- Use only content from the website to parse the data that will not quickly change such as class and id names. Don't use spaces or number of pixels etc..

- The scraper should be working for all available input form the destinations array.

OUTPUT ARRAYS:

- $price

- $currency always a 3 letter code example: EUR (for euro) or USD (United states dollar) THis is the currency where the price was given for.

- $pricetag this contains a string IF 1 or more carriers are given, which is the

- $depdate FORMAT: yyyy-mm-dd

- $deptime FORMAT: 00:00

- $arrdate FORMAT: yyyy-mm-dd

- $arrtime FORMAT: 00:00

- $transfers

- $bookinglink a deep link for the particular travel

- $bookinglinkretour a deeplink for the particular travel where the returndate is defined by: retourday retourmonth retouryear these 'variables' represent numbers. Note that it is not a php variable but just a string that you put in the deep link for a retour journey where you find the return date.

Taidot: PHP, Tietojen kaavinta verkosta

Näytä lisää: web developer website names, web developer names, web developer explanation, using regular expressions, using expressions, travel website web developer, travel websites developer, regular expressions example, reference letter example, parsing input, letter reference example, letter explanation, need find web developer, need find developer web, looking one web developer, make website php, use regular expressions, make travel website, get experience web developer, good web developer, regular expressions work

About the Employer:
( 64 reviews ) Goes, Netherlands

Projektin tunnus: #4238419

14 freelanceria on tarjonnut keskimäärin 180 $ tähän työhön

SigmaVisual

I can help in your project, please check PMB and our ratings/reviews to get idea of our experience. Please let me know if you have any queries.

145 $ USD 2 päivässä
(228 arvostelua)
7.8
mistersoft

please provide source web-site in PMB. Thanks

250 $ USD 4 päivässä
(382 arvostelua)
7.4
mantislin

Hi sir, please check PM, thx Kimi.

248 $ USD 5 päivässä
(162 arvostelua)
6.7
garygoog

Please check PM

150 $ USD 10 päivässä
(35 arvostelua)
5.8
jitendraparmar07

Automation expert here. I can easily write such a bot/scraper.Please check your PMB.

150 $ USD 2 päivässä
(13 arvostelua)
4.8
MinorityPath

hi, please check pm box

100 $ USD 3 päivässä
(14 arvostelua)
4.1
phpmysqlrocks

Ready ti start. Please check PMB. Thanks

170 $ USD 2 päivässä
(10 arvostelua)
4.1
matideveloper

Please take a look at your PMB for more information.

150 $ USD 3 päivässä
(4 arvostelua)
4.0
webstechno

Please check our private message for more details. Thanks Webs Techno

150 $ USD 2 päivässä
(8 arvostelua)
3.4
zhsoftstudio

Hello bwesteinde, Please provide website URL by PM for detailes. Thanks.

250 $ USD 5 päivässä
(8 arvostelua)
3.0
pyramidSoft

web crawler

200 $ USD 10 päivässä
(3 arvostelua)
2.6
devbogdan111

Hi , I've done projects like this one before . Please check PMB .

150 $ USD 2 päivässä
(3 arvostelua)
2.4
XtrigonWebSoln

We are ready to work with you. Thanks & Regards, Xtrigon Web Solutions

175 $ USD 15 päivässä
(0 arvostelua)
0.0
realstuffs

Hello Sir, We have gone through your requirement and we are will capeble of building scrappers you want.Please check your message box for more.

300 $ USD 4 päivässä
(0 arvostelua)
0.0
Nightbloos

Hi. I have good experience in creating of parsers using curl+regexp.

100 $ USD 3 päivässä
(0 arvostelua)
0.0