XF 1.2 Text for robot.txt

[easiii]

Hello,
Just bought, and downloaded Xenforo. I have not seen an inlcuded robot.txt file.... Is there one available ??

Thank you!

 

[Andy.N]

http://xenforo.com/robots.txt

 

[easiii]

Thank you! Is there anything else that I should add?

 

[Andy.N]

It's up to you really.

 

[CTXMedia]

Here's what I have in mine (if you want other examples for reference):

User-agent: *
Disallow: /account/
Disallow: /admin.php
Disallow: /ajax/
Disallow: /attachments/
Disallow: /conversations/
Disallow: /find-new/
Disallow: /goto/
Disallow: /help/
Disallow: /login/
Disallow: /lost-password/
Disallow: /members/
Disallow: /mobiquo/
Disallow: /online/
Disallow: /posts/
Disallow: /recent-activity/
Disallow: /register/
Disallow: /search/

 

[easiii]

Thank you! This was what I was looking for!