DRE
Well-known member
I'm using the bots online addon but I don't see a place to add spiders: http://xenforo.com/community/threads/bots-online-temporary-until-made-a-part-of-xf.24384/
http://xenforo.com/community/threads/crawler-spider-name-add-on.28939/
http://www.wolfshead-solutions.com/spiders-list
http://xenforo.com/community/threads/crawler-spider-name-add-on.28939/
http://www.wolfshead-solutions.com/spiders-list