• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.
Robots

Robots 1.8

No permission to download
Disallows robots from indexing your site unless explicitly allowed.
Compatible XF 1.x versions
1.2, 1.3, 1.4, 1.5
Description:

Disallows robots from indexing your site unless explicitly allowed.
(Robots link in Visitors tab)

pic001.jpg


(Example of Robots page)

pic002.jpg


(Example of Options page)

pic003.jpg


(Example of User Group Permissions)

pic004.jpg


Features:
  • All phrases start with robots_ for your convenience.
Installation:
  1. Download robots_v1.8.zip and unzip it.
  2. Upload the Andy folder to your server. The correct location is library/Andy.
  3. From your Admin Control Panel, go to the "Install Add-on" page.
  4. Upload the addon-Robots_v1.8.xml file.
  5. Click the Install Add-on button.
User Group Permissions:

Set the Administrative user group permissions to Allow. This allows Admin to see the Robots link under the Visitor tab.

Questions and Answers:

Q: What is the purpose of this add-on?
A: Lots of robots crawling your forum will slow it down.

Q: I noticed a robot crawling my site but it's identified as a guest.
A: You need to add the name to the Robot Names field in the Options.

Q: What happens if a robot which is not allowed comes to my site?
A: It receives a blank page.

Q: Why not use the robots.txt file to restrict robots?
A: Because 99% of all robots ignore this file.​

Database modifications:

This add-on will create a table called xf_robots in your database.

Sending a donation:

If you like this add-on, please consider sending a small donation.

https://www.paypal.me/andybajka

Thank you.
Author
AndyB
Downloads
236
First release
Last update
Rating
5.00 star(s) 3 ratings

More resources from AndyB

Latest updates

  1. See description

    Robots v1.8 changes: Added code to limit the 'type' field in the xf_robots table.
  2. See description

    Robots v1.7 changes: Updated Template Modification to use Regular Expression.
  3. See description

    Robots v1.6 changes: Updated PHP code.

Latest reviews

Great tool for stopping some common scrapers, undesired bots and such. Its one of the many tools in my arsenal against bots and I highly recommend it.
This is excellent and should be core for xenForo. Bad bots can be a huge resource hog eating up bandwidth and slowing your site down for nothing gained. This add-on installs in no time and works right out of the box! This is yet another one of his brilliant add-ons that should be included in the core of xenForo. Thank you Andy!
This is really quite an interesting, and yet novel approach to discourage unwanted robots away from your forums.(i.e. Feed them Blank pages!)

Remember to set the User Group Permissions to 'Allow' for both the Unregistered/Unconfirmed & Registered groups so the add-on can function properly.