1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Does XF recognize Spiders (bots)?

Discussion in 'XenForo Questions and Support' started by rotpar, Apr 29, 2013.

  1. rotpar

    rotpar Member

    Hi there,

    just one question, does XF recognize search engine spiders (bots). If so, where does it take the actual ip's etc. from? Is there a updated file?

    I ask because of some addon which states that it recognizes google bots etc. but I couldn't see anything in the code what could indentify a spider (bot). So does XF have anything like that in the code?

    Thank you
  2. Jeremy

    Jeremy XenForo Moderator Staff Member

    I believe, and I may be wrong, that XenForo doesn't recognize bots as bots, but as guests. I know that bots will look for a robots.txt file for rules about indexing your site.

Share This Page