Create me a robots.txt file to delay crawlers from pinterest and optimise my server
£10-20 GBP
Lezárt
Kiadva ekkor: majdnem 5 évvel ezelőtt
£10-20 GBP
Teljesítéskor fizetve
Pinterest crawlers have brought my dedicated server to its knees with crawling it
I don't want to block the crawlers because i will be penalised i want someone to
make a [login to view URL] file with a crawl delay witch will let my traffic threw as well as pinterest been able to crawl. So that means you will have to copy the [login to view URL] file in to the cpanel root directory of every cpanel and then i want you to copy it to every addon domain folder. This can be accomplished in bulk instead of doing it manually
Hi client!
I am going to do your project.
I have been make these projects for 2 years. so I would like you to give me this task.
Thank you for your invitation.