Suoritettu

a little PHP help

I have a script that scrapes data from a website...

They have recently change the code to only allow 50 results per page SO now I am having issues getting to the second page of data.... please adjust my code to get the second page of data...

current code:

$curl = curl_init();

curl_setopt($curl, CURLOPT_SSL_VERIFYPEER, FALSE);

curl_setopt($curl, CURLOPT_HEADER, 1);

curl_setopt($curl, CURLOPT_POST, false);

curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);

curl_setopt($curl, CURLOPT_USERAGENT, "Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.9.1.2) Gecko/20090729 Firefox/3.5");

curl_setopt($curl, CURLOPT_FOLLOWLOCATION, true);

curl_setopt($curl, CURLOPT_COOKIEFILE, $cookie_file);

curl_setopt($curl, CURLOPT_COOKIEJAR, $cookie_file); // SAME cookiefile

$fromday = date('d', strtotime(' -0 day'));

$frommonth = date('m', strtotime(' -0 day'));

$fromyear = date('Y', strtotime(' -0 day'));

$today = date('d', strtotime(' -0 day'));

$tomonth = date('m', strtotime(' -0 day'));

$toyear = date('Y', strtotime(' -0 day'));

$todayDate = date('m/d/Y', strtotime(' -0 day'));

$todayDate1 = date('Y/m/d', strtotime(' -0 day'));

echo $url = "[login to view URL]$frommonth%2f$fromday%2f$fromyear&ReleaseDateEnd=$tomonth%2f$today%2f$toyear&matches=50";

curl_setopt($curl, CURLOPT_POST, true);

curl_setopt($curl, CURLOPT_POSTFIELDS, $postdata);

curl_setopt($curl, CURLOPT_URL, $url);

$html = curl_exec($curl);

$html = preg_replace('~>\s+<~', '><', $html);

//get DCNumber for each inmate

preg_match_all("/DCNumber=(.*?)&TypeSearch=IR/", $html, $DCmatch);

$totalcount = count($DCmatch[0]);

Taidot: PHP, Tietojen kaavinta verkosta

Näytä lisää: php disallow java script, php file uploader script, php news comment script, php forwarding emails script, php asp mail script, php shoppingcom api3 script, php video resize script, free php enquiry form script web site, ajax php drag drop script, php web scrape script, php uplad zip script, php video upload script, php video gallery script, php email oscommerce script, create php link dump script, php word count doc file script

Tietoa työnantajasta:
( 93 arvostelua ) Newnan, United States

Projektin tunnus: #20446681

Myönnetty käyttäjälle:

gangabass

I can fix your current PHP scraper in less than two hours for just $25. It will process each Next page until the end and parse results.

$25 USD 1 päivässä
(455 Arvostelua)
7.4

23 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön

moonwebtech

Hello, I read your requirement carefully and bid here. I can fix your PHP curl script in a few hours. As you can see my profile, I am a professional PHP developer. And I worked as a freelancer more than 8 years. Pleas Lisää

$35 USD 1 päivässä
(224 arvostelua)
7.4
sunnysmile911

Hi I read the project description and it seems to be an hour or less work. I am a senior full-stack web developer with 5+ years of experience. I built many websites using PHP based frameworks. Here are the websites I b Lisää

$30 USD 7 päivässä
(32 arvostelua)
6.5
shihan033010

Hi i am interested in your project. I am expert in php. Please give me the opportunity to start the project. Thanks Shihan

$30 USD 1 päivässä
(311 arvostelua)
6.8
elbruninh

Hi, i'm interested but the $postdata var is missing in your code, can you check? if so, can you send me the full source code? i can do it regards [login to view URL]

$35 USD 1 päivässä
(101 arvostelua)
6.5
webcast

Hello sir, I am good at : 1. WordPress, Shopify, Magento, Opencart, Joomla web development 2. PSD to HTML 3. Responsive web development 4. Graphics Designing 5. Photoshop 6. PHP 7. html + CSS Styling 8. js & jQuery. Lisää

$30 USD 1 päivässä
(96 arvostelua)
5.5
webfastsolution

Hi Sir, I will adjust you script to get second page data with loops with quality work. Sir i will start work immediately and complete within few minutes. Thank you

$15 USD 1 päivässä
(47 arvostelua)
5.1
BlackEagle86

Hi I am available to do your project and very interested. Your required task actually map on my skill sets. As I am PHP, Scraping Expert, I can say that I can do it perfectly I want love to do this with full dedication Lisää

$20 USD 7 päivässä
(8 arvostelua)
5.1
sherazm

I can do this task. i have worked on many projects like this. ping me for more details and also check out my reviews. thanks

$15 USD 1 päivässä
(21 arvostelua)
5.1
CreativeExpertIT

Hello Sir, In first reading it would start working after change below line [login to view URL];Page=List&amp;DataAction=Filter&amp;ReleaseDateBeg=$frommonth%2f$fromday Lisää

$30 USD 1 päivässä
(45 arvostelua)
4.9
yousufkhan39911

I have read the description and I can fix the script of data scraping as per your requirements. I can do it asap.

$29 USD 1 päivässä
(61 arvostelua)
4.6
khoadeveloper

Hi, Dear client. I am a web scraping/automation/bot/chrome extension expert with 6 years of experience in NodeJS, Puppeteer, Chromy, Selenium, Chrome-extension, Chrome-headless, Firefox-headless, SilmerJS, PhantomJS, Lisää

$30 USD 1 päivässä
(3 arvostelua)
4.1
TopDesigner315

Thank you for your post, sir. I have a good chance of bidding your project. I have good experience of data scraping from some websites. For example, from Amazon site, I have ever scrapped the products. Such as name, pr Lisää

$50 USD 7 päivässä
(9 arvostelua)
3.9
Scorpius1116

Hi !!! Nice to meet you. Web Site / Web App development Expert here I have gone through the complete job description and placed bid accordingly. I am really confident in this part. This is what I have alre Lisää

$20 USD 2 päivässä
(4 arvostelua)
3.9
rishuwork17

I am AWS, Azure and google cloud certified server and Linux expert having 5 years of experience on migration of web application. I have good hands on Cpanel and server migration and LAMP deployment like Wordpress, mag Lisää

$20 USD 1 päivässä
(20 arvostelua)
3.6
BestService222

Dear client, how have you been? I've read your project description carefully. I am a excellent Full-Stack Web development expert. I think your project is very suitable for me. I 'm very interested in your project. Lisää

$30 USD 2 päivässä
(11 arvostelua)
4.3
bharatpraj

Hello, I'm Bharat I'm interesting your project very well I'm good in Website Design,PSD TO HTML HTHML, CSS , JAVASCRIT, JQUERY, AJAX, PHP, Wordpress,Codeigniter,laravel and mysql expert. I’m quite well experienced Lisää

$10 USD 1 päivässä
(8 arvostelua)
2.5
xueqingdba

Hello. I have seen the above requirements. The code is about api request to scrape data needed. That code doesn't redirect to new page correctly. Only a few lines of code are needed. I can finish it in 5 mins surely. Lisää

$30 USD 1 päivässä
(1 arvostelu)
2.5
shankarkanasecse

Hello Sir, I am interested in your job. I have good experience on PHP, CURL,Wordpress, Codeigniter, HTML, CSS, MySQL. I have worked on lots of Scrapping applications. I can work for you in less price with good qualit Lisää

$20 USD 2 päivässä
(0 arvostelua)
0.0
tophatindore

Hello, As per the requirement for the job post and also gone through your mention points. I am confident enough to work on this. I can deliver the best. As I am having 5+ years of experience in UI/UX. I am well verse Lisää

$20 USD 7 päivässä
(0 arvostelua)
0.0
pratikpatel4057

hi, I have 2+ years of experience I php and it's framework like codeignitor and laravel and yii and other. I can fix that for you.

$25 USD 2 päivässä
(0 arvostelua)
0.0