Fix PHP code for website product scraping

I have a custom code that is used to scrape data from a different website and save images and data in MySQL database. It uses simplehtmldom and Nokogiri to scrape and parse data, angrycurl for proxy connection, etc.. MVC framework is used through the code.

There are bugs and issues that need to be fixed with the code and I need to developer who understand scraping to look into it.

Issues are:

1. fix all the scrapers for the different website to ensure there is no errors and the correct data is being scraped with the correct logic applied before saving into database.

2. There is a refresh mechanism so if the information of a product is changed, products are listed in the refreshed products page. There is a bug prevent this from working.

3. The script also greater XML and csv with product information. Some changes are required to the data and layout of these files.

4. There are currently 2 x [login to view URL] files, so configuration information is saved in two files. Need to merge them info one fire and ensure its secure/safe.

5. Optimize code/script for security and speed of scraping.

Please refer to the attached screnshots.

Taidot: PHP, MySQL, MVC, Tietojen kaavinta verkosta, Scrapy

Näytä lisää: how to extract php code from a website, web scraping php curl, web scraping php domdocument, php web scraping tutorial, how to fetch data from another website in php, learn how to extract data from websites with php, extract data from a website using php script, scrape content from website php, fix php code, zend encryption secure php code website, html fix php code, rip php code website, integrate php code website, can collect feedback using php code website server, find programmer fix php code, iframe virus fix php code, php code website movie thumbnails, php code website, attaching webcamera add php code website, create php code add product

Tietoa työnantajasta:
( 4 arvostelua ) Sydney, Australia

Projektin tunnus: #26522866

Myönnetty käyttäjälle:


Dear Client, I am a master class expert on Python and PHP where I used that python for scrapping, and PHP to fix your bug, I think i can do u job right now. I do the task first then take the payments, so if you are Lisää

$25 AUD 7 päivässä
(1 arvostelu)

12 freelanceria on tarjonnut keskimäärin 49$ tähän työhön


Hello Sir, I am senior programmer in Scrapper with PHP/Laravel, MySQL certificated freelancer who is qualified in this part. ********** I AM READY TO START NOW *********** . 110+ projects are completed successfully Lisää

$35 AUD 2 päivässä
(106 arvostelua)
(64 arvostelua)

I have 5 years experience in codigniter, MVC and dom [login to view URL] you check my previous work then you understand my skill. I am ready to scrape data in correct [login to view URL] for reply

$100 AUD 2 päivässä
(46 arvostelua)

Hi, Scraping data is depends on third party. We have to put our logic according to incoming data. Your budget is very less. Can we deal this project using hourly? Please come for further discussion. Thanks, Ziya

$30 AUD 1 päivässä
(69 arvostelua)

hi am interested in your project and want to provide my best for this. myself 6 years experienced developer. for assurance of quality work you can check my reviews. we can discuss more about it via messages. thanks

$50 AUD 1 päivässä
(60 arvostelua)

hi, I have more than 8yrs exp in Webdesign/Laravel / PHP / WordPress / PSD to HTML /bootstrap / Photoshop ... you can check my projects in my profile. I can start now, can you give me more details?

$100 AUD 7 päivässä
(12 arvostelua)

Hi Greetings for the day ! Being a Full stack Developer and a DBA with 7 years of expertise I can deliver this requirement very soon with preciseness and jitter and also consider my profile as I would be very pleased Lisää

$50 AUD 1 päivässä
(6 arvostelua)

Hey. I am a freelance professional. My work experience is more than 10 years. Lots of examples and good reviews. I will do your work carefully, efficiently and quickly!

$20 AUD 7 päivässä
(2 arvostelua)

Hi there, Our profile is new but we have a well-dedicated team of FULL STACK/MEAN-MERN DEVELOPERS. I can assure you that we will be able to assist you with the best quality work. Please start the interview process so Lisää

$20 AUD 7 päivässä
(0 arvostelua)

Depending on the amount of websites to review the scraping, looks like a basic task that can be done in a day or two. If we understand this right, our team would work on: - Review the parsing of data from different sit Lisää

$56 AUD 2 päivässä
(0 arvostelua)

Hello! I can provide you full support for this project. I have high experience with web technologies and I am pretty sure I can help you. So, let's start!

$75 AUD 7 päivässä
(0 arvostelua)