The scenario is that you have a site on a staging server, the site has many links to external pages that are running google analytics. This in itself is fine until you start testing the links and google finds your staging site. again not a problem if you have set your robots.txt to disallow /*, but what about if you didn't and the site has now been indexed! all 700 pages of it!
Well firstly set the robots.txt and the header of each page with:
This will help any further crawls.
Code: Select all
<?php header('X-Robots-Tag: noindex,noarchive,nofollow'); ?>
You can then put the site into maintenance mode in the [Site Admin->Settings - Global Settings->Maintenence Mode]
set the "Down for Maintenance" to Yes
now the site will be down for external users. You can add the testers IP addresses to the "Exclude these IP addresses" field.
Then they can test away without letting google index the site.
what happens when you want to use the CMSMS Linker plugin on the MicroTiny WYSIWYG editor, answer is it won't work in maintenance mode.
"I know that sucks" I here you say, not so, as this is a security feature after all and how secure would it be if it allow ajax calls while in maintenance mode.
The solution is simple, add the server IP to the "Exclude these IP Addresses" field this allows CMSMS Linker to make the ajax calls to the server and return the correct links.
I also discovered that the same issue befalls the PDFGenerator Module as it requires the module to make a call to build the PDF for output and returns a blank PDF, but not anymore.
I am sure there will be other occasions that this would be the case and hope that it will stop you scratching your heads and getting frustrated.
it's all good and we can move forward