• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.
Robots

Robots 2.1

No permission to download
Compatible XF 1.x versions
1.2, 1.3, 1.4, 1.5
Description:

Disallows robots from indexing your site unless explicitly allowed.

(Robots link in Visitors tab)

pic001.jpg


(Example of Robots page)

pic002.jpg


(Example of Options page)

pic003.jpg


(Example of User Group Permissions)

pic004.jpg


Features:
  • All phrases start with robots_ for your convenience.
Installation:
  1. Download robots_v2.2.zip and unzip it.
  2. Upload the Andy folder to your server. The correct location is library/Andy.
  3. From your Admin Control Panel, go to the "Install Add-on" page.
  4. Upload the addon-Robots_v2.2.xml file.
  5. Click the Install Add-on button.
User Group Permissions:

Set the Administrative user group permissions to Allow. This allows Admin to see the Robots link under the Visitor tab.

Questions and Answers:

Q: What is the purpose of this add-on?​
A: Lots of robots crawling your forum will slow it down.​
Q: I noticed a robot crawling my site but it's identified as a guest.​
A: You need to add the name to the Blacklist field in the Options page.​
Q: What happens when a robot is blocked?​
A: It receives a blank page.​
Q: Why not use the robots.txt file to restrict robots?​
A: Because robots ignore this file.​

Database modifications:

This add-on will create a table called xf_robots in your database.

Sending a donation:

If you like this add-on, please consider sending a small donation.

https://www.paypal.me/andybajka

Thank you.
Author
AndyB
Downloads
254
First release
Last update
Rating
5.00 star(s) 3 ratings

More resources from AndyB

  • Member Notes
    Member Notes
    Allows staff to create member notes.
  • Similar threads
    Similar threads
    Shows a list of similar threads when a user is creating or viewing a thread.
  • Trader
    Trader
    Allows giving feedback on sellers and buyers.
  • Most posts
    Most posts
    Displays a Most Posts widget.
  • Most likes
    Most likes
    Displays a Most likes widget.

Latest updates

  1. See description

    Robots v2.1 changes: This version has many changes. Please uninstall any previous version...
  2. See description

    Robots v2.0 changes: Updated Options page. I suggest doing a full uninstall of any older...
  3. See description

    Robots v1.9 changes: Updated Robot Names in the Options page. I suggest uninstalling any...

Latest reviews

Great tool for stopping some common scrapers, undesired bots and such. Its one of the many tools in my arsenal against bots and I highly recommend it.
This is excellent and should be core for xenForo. Bad bots can be a huge resource hog eating up bandwidth and slowing your site down for nothing gained. This add-on installs in no time and works right out of the box! This is yet another one of his brilliant add-ons that should be included in the core of xenForo. Thank you Andy!
This is really quite an interesting, and yet novel approach to discourage unwanted robots away from your forums.(i.e. Feed them Blank pages!)

Remember to set the User Group Permissions to 'Allow' for both the Unregistered/Unconfirmed & Registered groups so the add-on can function properly.