XF 1.3 Robots?!

[Connor Smith]

Hey Guys!
So I was always curious to what robots on XenForo sites where. I notices THIS thread, but I couldn't seem to find my robots.txt or if i am supposed to make one.
Could someone help me out with these robots, and if you could describe to me how it works and their purposes.

Thanks!

 

[Paul B]

Create one and upload it to your web root.

For example: http://xenforo.com/robots.txt

https://support.google.com/webmasters/answer/156449?hl=en

 

[Connor Smith]

Create one and upload it to your web root.

For example: http://xenforo.com/robots.txt

https://support.google.com/webmasters/answer/156449?hl=en

Thank you!