1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

XF 1.4 Robots.txt gone since upgrade to XF 1.4

Discussion in 'Troubleshooting and Problems' started by 1BJK903, Oct 28, 2014.

  1. 1BJK903

    1BJK903 Active Member

    Hi all,

    Is this a common problem? I saw on Webmaster Tools that "Googlebot can't access the page".... Well, than I checked the robots.txt, but I couldn't find it anymore. Why is it gone? And how do I add it back?
  2. Chris D

    Chris D XenForo Developer Staff Member

    XenForo doesn't ship with a robots file, nor would it remove one after an upgrade.

    Are you sure you ever had one?

    An example can be found here:


    It will need some customisation to work for your site.
    1BJK903 likes this.
  3. 1BJK903

    1BJK903 Active Member

    Well, I thought I had one.. Anyhow, so I have to add it in the public html of my website and that's enough?
  4. Chris D

    Chris D XenForo Developer Staff Member

    Yeah that's it.
    1BJK903 likes this.
  5. Martok

    Martok Well-Known Member

    Yes, put it in the root. Make sure you customise it as Chris suggested to suit your needs. If you're unsure about this, search these forums as there are several threads about robots.txt files.
    1BJK903 and Chris D like this.
  6. 1BJK903

    1BJK903 Active Member

    Thanks guys.

Share This Page