1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Robots 1.5

Disallows robots from indexing your site unless explicitly allowed.

  1. AndyB
    Compatible XF Versions:
    • 1.2
    • 1.3
    • 1.4
    • 1.5
    Description:

    Disallows robots from indexing your site unless explicitly allowed.
    (Robots link in Visitors tab)

    pic001.jpg

    (Example of Robots page)

    pic002.jpg

    (Example of Options page)

    pic003.jpg

    (Example of User Group Permissions)

    pic004.jpg

    Features:
    • All phrases start with robots_ for your convenience.
    Installation:
    1. Download robots_v1.5.zip and unzip it.
    2. Upload the Andy folder to your server. The correct location is library/Andy.
    3. From your Admin Control Panel, go to the "Install Add-on" page.
    4. Upload the addon-Robots_v1.5.xml file.
    5. Click the Install Add-on button.
    Setup:

    Set the Unregistered / Unconfirmed and Registered group permissions to Allow. The Allow setting means the Robots add-on will function for that user group.

    Questions and Answers:

    Q: What is the purpose of this add-on?
    A: Lots of robots crawling your forum will slow it down.

    Q: I noticed a robot crawling my site but it's identified as a guest.
    A: You need to add the name to the Robot Names field in the Options.

    Q: What happens if a robot which is not allowed comes to my site?
    A: It receives a blank page.

    Q: Why not use the robots.txt file to restrict robots?
    A: Because 99% of all robots ignore this file.​

    Database modifications:

    This add-on will create a table called xf_robots in your database.

    Installation:
    1. Download robots_v1.5.zip and unzip it.
    2. Upload the Andy folder to your server. The correct location is library/Andy.
    3. From your Admin Control Panel, go to the "Install Add-on" page.
    4. Upload the addon-Robots_v1.5.xml file
    5. Click the Install Add-on button.
    Sending a donation:

    If you like this add-on, please consider sending a small donation.

    https://www.paypal.me/andybajka

    Thank you.

Recent Updates

  1. See description
  2. See description
  3. See description

Recent Reviews

  1. adwade
    adwade
    5/5,
    Version: 1.5
    This is really quite an interesting, and yet novel approach to discourage unwanted robots away from your forums.(i.e. Feed them Blank pages!)

    Remember to set the User Group Permissions to 'Allow' for both the Unregistered/Unconfirmed & Registered groups so the add-on can function properly.