Robots [Deleted]

[AndyB]

AndyB updated Robots with a new update entry:

See description

Robots v2.3 changes:

Added Cron entry to delete all data in the xf_andy_robts table older than 24 hours. The Cron entry runs once a day.

Read the rest of this update entry...

 

[AndyB]

AndyB updated Robots with a new update entry:

See description

Robots v2.4 changes:

Updated setup to use schema manager.

Read the rest of this update entry...

 

[AndyB]

AndyB updated Robots with a new update entry:

See description

Robots v2.5 changes:

Now using finder for performing database queries.

Read the rest of this update entry...

 

[AndyB]

AndyB updated Robots with a new update entry:

See description

Robots v2.6 changes:

Fixed issue with Cron entry not deleting old data.

Read the rest of this update entry...

 

[spirogg]

Cant leave a rating for some reason, but this add-on is fantastic and works as described..

thank you @AndyB

 

[mazzly]

@AndyB Could you add the Mozilla/5.0 (compatible; AMPXFBot/1.0; +http://ampxf.com/bot) bot to the default whitelist? It is blocking some mutual customers of ours

 

[mazzly]

I would also suggest that the addon should return e.g. a 403 fobidden status with empty page rather than a 200 status which means "all okay", Otherwise robots won't know that the page is not allowed and they will continue crawling it..

 

[Vilandra]

Hi Andy Are there any plans to bring this one back?

 

[AndyB]

This resource has been removed and is no longer available.