• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.

Does XF recognize Spiders (bots)?

#1
Hi there,

just one question, does XF recognize search engine spiders (bots). If so, where does it take the actual ip's etc. from? Is there a updated file?

I ask because of some addon which states that it recognizes google bots etc. but I couldn't see anything in the code what could indentify a spider (bot). So does XF have anything like that in the code?

Thank you
 

Jeremy

Well-known member
#2
I believe, and I may be wrong, that XenForo doesn't recognize bots as bots, but as guests. I know that bots will look for a robots.txt file for rules about indexing your site.