Suljettu

Custom WordPress web-crawler needed

I need a custom web crawler/scraper for a WordPress information site.

How I want it to work is thus:

- It needs to be a WordPress plugin.

- There will be about 60 different topics. Each topic will have 10 or so webpages which need to be scraped and made into WordPress posts. E.g. one topic may be â??universityâ?? and have a list of ten pages under the university category.

- The data on these pages will change every few days so it will need to scrape to check for any new updates regularly and make posts of these.

- Each webpage that needs to be scraped is literally that â?? a URL to a single webpage. No RSS feeds.

- Each webpage will have URLs on them which will link to more detail. It is these URLs which need to be converted into WordPress posts. One post for each URL link. The post created will contain the information in the URL link and also a copy of the link too so people can follow it for more information.

- The new post will then need to be tagged according to which topic it came under. E.g. if this website was under the â??universityâ?? topic list, the posts will be tagged with â??universityâ??.

- The plugin should have a way of alerting a site administrator to any new posts that have been created so that they can be checked.

- It should be possible and straightforward for the site admin to add new websites to scrape and new topics relatively easily.

- It should allow another WordPress plugin to work where posts will expire and be taken offline after a certain date.

All the crawled data is freely available to the public and there are no copyright concerns. The posts created from the scraped data will link back to the site the data came from.

It needs to abide by the usual Wordpress guidelines for plugins such as being API based with a core plugin, extensions as needed and use hooks, filters etc. The usual setup.

Taidot: HTML, PHP, tietojärjestelmäarkkitehtuuri, Tietojen kaavinta verkosta, WordPress

Näytä lisää: wordpress web crawler, wordpress hooks list, wordpress core, wordpress copyright, rss plugin wordpress, need web administrator, want make website freely, wordpress web, wordpress web site, wordpress api, wordpress administrator, website crawler, setup new wordpress, data crawler, custom wordpress plugins, crawler, wordpress list category post, wordpress topic, web data crawler, wordpress plugin category, copy web list, wordpress post list, wordpress post link pages, wordpress change url site, wordpress custom post urls

About the Employer:
( 0 reviews ) United Kingdom

Projektin tunnus: #1714738

9 freelanceria on tarjonnut keskimäärin 222 $ tähän työhön

SigmaVisual

We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

250 $ USD 7 päivässä
(235 arvostelua)
7.8
mtthardy4

Expert here check pm thank nitya

230 $ USD 3 päivässä
(139 arvostelua)
6.7
violetzs

I can do it. Please discuss with me

200 $ USD 5 päivässä
(95 arvostelua)
6.5
dotsaravanan

Thanks for your post, kindly have a look on our PMB

250 $ USD 5 päivässä
(13 arvostelua)
5.5
artsnlogic

Expert data scraper here and have great WordPress experience too. Detailed proposal in the PMB. Thanks, Irfan - The Administrator removed this message for containing contact details which breaches our Terms of Service

250 $ USD 7 päivässä
(17 arvostelua)
5.0
Bistechsupport

Hi, This is Jeni from bistech support. We would like to inform you that we could able to develop this project. Please find the attached document for your reference. our ball park quote is 100 USD. Plea Lisää

100 $ USD 7 päivässä
(28 arvostelua)
4.7
shoaib777

Willing to start work right away. Please send me details in PMB. Thanks

250 $ USD 30 päivässä
(2 arvostelua)
2.6
techsentence

Hi, Chk PM

200 $ USD 7 päivässä
(1 arvostelu)
0.0
pmurugan

Hi, I have experience in web crawling in java as well as php to scrap the site and maintain the updates.

300 $ USD 10 päivässä
(0 arvostelua)
0.0
Wg7O4TV5u

Custom software development - <b><i>Removed by Admin</i></b>

250 $ USD 1 päivässä
(0 arvostelua)
0.0
leonminor

Hello It is our pleasure to work with you on your project. We are willing to provide you quality services,please look further for the expertise on our work. Kind Regards

200 $ USD 10 päivässä
(0 arvostelua)
0.0