• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.

XF 1.2 Text for robot.txt

easiii

Active member
#1
Hello,
Just bought, and downloaded Xenforo. I have not seen an inlcuded robot.txt file.... Is there one available ??

Thank you!
 

CyclingTribe

Well-known member
#5
Here's what I have in mine (if you want other examples for reference):

Code:
User-agent: *
Disallow: /account/
Disallow: /admin.php
Disallow: /ajax/
Disallow: /attachments/
Disallow: /conversations/
Disallow: /find-new/
Disallow: /goto/
Disallow: /help/
Disallow: /login/
Disallow: /lost-password/
Disallow: /members/
Disallow: /mobiquo/
Disallow: /online/
Disallow: /posts/
Disallow: /recent-activity/
Disallow: /register/
Disallow: /search/