It's not necessary to add a robots.txt file in the root directory ??Password protect it using htaccess auth or IP.
Protecting admin.php, the /install directory, and test & development installations using .htaccess
If you want to provide an extra layer of protection to admin.php, the /install directory, and test & development installations, you can do so with .htaccess authentication. Protecting admin.php To protect admin.php, edit the .htaccess file...xenforo.com
Ok i got it ! Thanks again PaulNot if the site is blocked.
Some crawlers don't respect robots.txt anyway.
You may create additional test installations for the purpose of testing the Software. Any test installation of this kind must be password protected, installed at a URL that makes the testing purpose clear, not used for production purposes and access to it must be limited to You and Your website staff.
Exactly !!To be fair don't the licence terms state any Web accessible version of a test/dev instance needs to be restricted anyway? As one licence = one public forum and one private test install?
We use essential cookies to make this site work, and optional cookies to enhance your experience.