Robots

Robots 2.1

No permission to download
Compatible XF 1.x versions
  1. 1.2
  2. 1.3
  3. 1.4
  4. 1.5
Description:

Disallows robots from indexing your site unless explicitly allowed.

(Robots link in Visitors tab)

pic001.webp


(Example of Robots page)

pic002.webp


(Example of Options page)

pic003.webp


(Example of User Group Permissions)

pic004.webp


Features:
  • All phrases start with robots_ for your convenience.
Installation:
  1. Download robots_v2.2.zip and unzip it.
  2. Upload the Andy folder to your server. The correct location is library/Andy.
  3. From your Admin Control Panel, go to the "Install Add-on" page.
  4. Upload the addon-Robots_v2.2.xml file.
  5. Click the Install Add-on button.
User Group Permissions:

Set the Administrative user group permissions to Allow. This allows Admin to see the Robots link under the Visitor tab.

Questions and Answers:

Q: What is the purpose of this add-on?​
A: Lots of robots crawling your forum will slow it down.​
Q: I noticed a robot crawling my site but it's identified as a guest.​
A: You need to add the name to the Blacklist field in the Options page.​
Q: What happens when a robot is blocked?​
A: It receives a blank page.​
Q: Why not use the robots.txt file to restrict robots?​
A: Because robots ignore this file.​

Database modifications:

This add-on will create a table called xf_robots in your database.

Sending a donation:

If you like this add-on, please consider sending a small donation.

https://www.paypal.me/andybajka

Thank you.
Author
AndyB
Downloads
307
Views
2,707
First release
Last update

Ratings

5.00 star(s) 5 ratings

More resources from AndyB

Latest updates

  1. See description

    Robots v2.1 changes: This version has many changes. Please uninstall any previous version...
  2. See description

    Robots v2.0 changes: Updated Options page. I suggest doing a full uninstall of any older...
  3. See description

    Robots v1.9 changes: Updated Robot Names in the Options page. I suggest uninstalling any...

Latest reviews

This is an Easy plugin to install and setup. does its job well. I was amazed at the amount of bots there were.

Thanks!
Great tool for stopping some common scrapers, undesired bots and such. Its one of the many tools in my arsenal against bots and I highly recommend it.
This is excellent and should be core for xenForo. Bad bots can be a huge resource hog eating up bandwidth and slowing your site down for nothing gained. This add-on installs in no time and works right out of the box! This is yet another one of his brilliant add-ons that should be included in the core of xenForo. Thank you Andy!
This is really quite an interesting, and yet novel approach to discourage unwanted robots away from your forums.(i.e. Feed them Blank pages!)

Remember to set the User Group Permissions to 'Allow' for both the Unregistered/Unconfirmed & Registered groups so the add-on can function properly.
Top Bottom