1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

XF 1.3 Robot.txt advice

Discussion in 'XenForo Questions and Support' started by Lexy, Jul 22, 2014.

  1. Lexy

    Lexy Active Member

  2. Brogan

    Brogan XenForo Moderator Staff Member

    Create a robots.txt file.

    Upload it to your web root.
     
  3. Lexy

    Lexy Active Member

  4. Martok

    Martok Well-Known Member

    Lexy likes this.
  5. Lexy

    Lexy Active Member

    without community
     
  6. Lexy

    Lexy Active Member

    why disalow post it is only for community
     
  7. Lexy

    Lexy Active Member

    so just need to delete community and add rest ones
     
  8. Lexy

    Lexy Active Member

    and looks like this??

    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /find-new/
    Disallow: /account/
    Disallow: /attachments/
    Disallow: /goto/
    Disallow: /login/
    Disallow: /admin.php
    Allow: /
    Sitemap: http://www.example.com/sitemap.xml
     
    Last edited: Jul 24, 2014
  9. Brogan

    Brogan XenForo Moderator Staff Member

  10. Lexy

    Lexy Active Member

    why disallow post?' it is only for xenforo who hosted on community
     
  11. Brogan

    Brogan XenForo Moderator Staff Member

  12. Lexy

    Lexy Active Member

    thanks
     

Share This Page