Create me a [login to view URL] file to delay crawlers from pinterest and optimise my server

Pinterest crawlers have brought my dedicated server to its knees with crawling it

I don't want to block the crawlers because i will be penalised i want someone to

make a [login to view URL] file with a crawl delay witch will let my traffic threw as well as pinterest been able to crawl. So that means you will have to copy the [login to view URL] file in to the cpanel root directory of every cpanel and then i want you to copy it to every addon domain folder. This can be accomplished in bulk instead of doing it manually

Taidot: MySQL, PHP, Web hosting

Näytä lisää: excel macro create txt file, create txt file html javascript, create txt file perl, create txt file cell excel macro, crawlers plugin wordpress robots txt, create write txt file windows application asp net, excel create txt file, java create binary tree txt file, create linked list given txt file java, robots.txt file, download robots.txt file, how to create robots.txt file for seo, google couldn t crawl your site because we were unable to access your site's robots txt file, how to create a txt file in android, how to create a txt file, robots.txt crawl-delay, has a data discrepancy further analysis blocked by a robots txt file, how to create robots.txt in wordpress, best robots txt file for opencart, vba how to create a txt file

Tietoa työnantajasta:
( 17 arvostelua ) Leeds, United Kingdom

Projektin tunnus: #19970521

8 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön


Hello I will add Crawl delay for Pinterest to your [login to view URL] file. Then I will upload it to your main and addon domains. We just need to add this line to them: User-agent: Pinterest *Crawl-delay: 50 Let me know an Lisää

£15 GBP 1 päivässä
(231 arvostelua)

Hello, got it work now , code added and fixed Hello, got it work now , code added and fixed Hello, got it work now , code added and fixed

£20 GBP 1 päivässä
(90 arvostelua)

Dear As an expert in web scraping, I developed 1000+ spiders using python, scrapy, php,nodejs,c# and proxies. And I scraped data and download images, files for CEOs and output result as csv, json, xml(yellow, ebay, w Lisää

£15 GBP 7 päivässä
(29 arvostelua)

Hello, I can do the work and can start working now. Please message me for further discussion. Best Regards, Zaiyan

£10 GBP 1 päivässä
(37 arvostelua)

Hello, I AM AVAILABLE RIGHT NOW. If you like we can discuss this project. I can do this task and create custom robot file. A few websites I created recently: [login to view URL] https://www.greentechpk. Lisää

£15 GBP 1 päivässä
(34 arvostelua)

Hi, I can build your web site in , WORDPRESS I have more than 10 years of experience in custom web development, project management and planning. In these years I have got a vast experience in gaining the client satisf Lisää

£15 GBP 7 päivässä
(6 arvostelua)
£23 GBP 1 päivässä
(7 arvostelua)

Hi client! I am going to do your project. I have been make these projects for 2 years. so I would like you to give me this task. Thank you for your invitation.

£18 GBP 1 päivässä
(0 arvostelua)