Custom WordPress web-crawler needed

I need a custom web crawler/scraper for a WordPress information site.

How I want it to work is thus:

- It needs to be a WordPress plugin.

- There will be about 60 different topics. Each topic will have 10 or so webpages which need to be scraped and made into WordPress posts. E.g. one topic may be â??universityâ?? and have a list of ten pages under the university category.

- The data on these pages will change every few days so it will need to scrape to check for any new updates regularly and make posts of these.

- Each webpage that needs to be scraped is literally that â?? a URL to a single webpage. No RSS feeds.

- Each webpage will have URLs on them which will link to more detail. It is these URLs which need to be converted into WordPress posts. One post for each URL link. The post created will contain the information in the URL link and also a copy of the link too so people can follow it for more information.

- The new post will then need to be tagged according to which topic it came under. E.g. if this website was under the â??universityâ?? topic list, the posts will be tagged with â??universityâ??.

- The plugin should have a way of alerting a site administrator to any new posts that have been created so that they can be checked.

- It should be possible and straightforward for the site admin to add new websites to scrape and new topics relatively easily.

- It should allow another WordPress plugin to work where posts will expire and be taken offline after a certain date.

All the crawled data is freely available to the public and there are no copyright concerns. The posts created from the scraped data will link back to the site the data came from.

It needs to abide by the usual Wordpress guidelines for plugins such as being API based with a core plugin, extensions as needed and use hooks, filters etc. The usual setup.

Taidot: HTML, PHP, tietojärjestelmäarkkitehtuuri, Tietojen kaavinta verkosta, WordPress

Näytä lisää: wordpress web crawler, wordpress hooks list, wordpress core, wordpress copyright, web-crawler, rss plugin wordpress, need web administrator, how to custom wordpress website, plugin scraper, i want to make website freely, few website which is created in wordpress, wordpress web, wordpress web site, wordpress api, WORDPRESS ADMINISTRATOR, website crawler, web scraper api, setup new wordpress, scrape web, scrape url for data and information, data crawler, custom wordpress plugins, crawler, wordpress list category post, wordpress topic

Tietoa työnantajasta:
( 0 arvostelua ) United Kingdom

Projektin tunnus: #1714738

9 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön


We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

$250 USD 7 päivässä
(235 arvostelua)

Expert here check pm thank nitya

$230 USD 3 päivässä
(139 arvostelua)

I can do it. Please discuss with me

$200 USD 5 päivässä
(95 arvostelua)

Thanks for your post, kindly have a look on our PMB

$250 USD 5 päivässä
(13 arvostelua)

Expert data scraper here and have great WordPress experience too. Detailed proposal in the PMB. Thanks, Irfan - The Administrator removed this message for containing contact details which breaches our Terms of Service

$250 USD 7 päivässä
(17 arvostelua)

Hi, This is Jeni from bistech support. We would like to inform you that we could able to develop this project. Please find the attached document for your reference. our ball park quote is 100 USD. Plea Lisää

$100 USD 7 päivässä
(28 arvostelua)

Willing to start work right away. Please send me details in PMB. Thanks

$250 USD 30 päivässä
(2 arvostelua)

Hi, Chk PM

$200 USD 7 päivässä
(1 arvostelu)

Hi, I have experience in web crawling in java as well as php to scrap the site and maintain the updates.

$300 USD 10 päivässä
(0 arvostelua)

Custom software development - <b><i>Removed by Admin</i></b>

$250 USD 1 päivässä
(0 arvostelua)

Hello It is our pleasure to work with you on your project. We are willing to provide you quality services,please look further for the expertise on our work. Kind Regards

$200 USD 10 päivässä
(0 arvostelua)