Robots

Robots 2.1

No permission to download
Compatible XF 1.x versions
  1. 1.2
  2. 1.3
  3. 1.4
  4. 1.5
Description:

Disallows robots from indexing your site unless explicitly allowed.

(Robots link in Visitors tab)

pic001.jpg


(Example of Robots page)

pic002.jpg


(Example of Options page)

pic003.jpg


(Example of User Group Permissions)

pic004.jpg


Features:
  • All phrases start with robots_ for your convenience.
Installation:
  1. Download robots_v2.2.zip and unzip it.
  2. Upload the Andy folder to your server. The correct location is library/Andy.
  3. From your Admin Control Panel, go to the "Install Add-on" page.
  4. Upload the addon-Robots_v2.2.xml file.
  5. Click the Install Add-on button.
User Group Permissions:

Set the Administrative user group permissions to Allow. This allows Admin to see the Robots link under the Visitor tab.

Questions and Answers:

Q: What is the purpose of this add-on?​
A: Lots of robots crawling your forum will slow it down.​
Q: I noticed a robot crawling my site but it's identified as a guest.​
A: You need to add the name to the Blacklist field in the Options page.​
Q: What happens when a robot is blocked?​
A: It receives a blank page.​
Q: Why not use the robots.txt file to restrict robots?​
A: Because robots ignore this file.​

Database modifications:

This add-on will create a table called xf_robots in your database.

Sending a donation:

If you like this add-on, please consider sending a small donation.

https://www.paypal.me/andybajka

Thank you.
Author
AndyB
Downloads
295
Views
1,576
First release
Last update
Rating
5.00 star(s) 4 ratings

More resources from AndyB

  • Wistia
    Wistia
    Creates a Wistia BB code media site.
  • Stitcher
    Stitcher
    Creates a Stitcher BB code media sites.
  • Anchor
    Anchor
    Creates an Anchor BB code media sites.
  • Approve all threads
    Approve all threads
    Approves all threads in approval queue.
  • Post check
    Post check
    Verifies posts have correct associated table data.

Latest updates

  1. See description

    Robots v2.1 changes: This version has many changes. Please uninstall any previous version...
  2. See description

    Robots v2.0 changes: Updated Options page. I suggest doing a full uninstall of any older...
  3. See description

    Robots v1.9 changes: Updated Robot Names in the Options page. I suggest uninstalling any...

Latest reviews

This is an Easy plugin to install and setup. does its job well. I was amazed at the amount of bots there were.

Thanks!
Great tool for stopping some common scrapers, undesired bots and such. Its one of the many tools in my arsenal against bots and I highly recommend it.
This is excellent and should be core for xenForo. Bad bots can be a huge resource hog eating up bandwidth and slowing your site down for nothing gained. This add-on installs in no time and works right out of the box! This is yet another one of his brilliant add-ons that should be included in the core of xenForo. Thank you Andy!
This is really quite an interesting, and yet novel approach to discourage unwanted robots away from your forums.(i.e. Feed them Blank pages!)

Remember to set the User Group Permissions to 'Allow' for both the Unregistered/Unconfirmed & Registered groups so the add-on can function properly.
Top