XF 1.4 Robots.txt gone since upgrade to XF 1.4

[1BJK903]

Hi all,

Is this a common problem? I saw on Webmaster Tools that "Googlebot can't access the page".... Well, than I checked the robots.txt, but I couldn't find it anymore. Why is it gone? And how do I add it back?

 

[Chris D]

XenForo doesn't ship with a robots file, nor would it remove one after an upgrade.

Are you sure you ever had one?

An example can be found here:

https://xenforo.com/robots.txt

It will need some customisation to work for your site.

 

[1BJK903]

XenForo doesn't ship with a robots file, nor would it remove one after an upgrade.

Are you sure you ever had one?

An example can be found here:

https://xenforo.com/robots.txt

It will need some customisation to work for your site.

Well, I thought I had one.. Anyhow, so I have to add it in the public html of my website and that's enough?

 

[Chris D]

Yeah that's it.

 

[Martok]

Well, I thought I had one.. Anyhow, so I have to add it in the public html of my website and that's enough?

Yes, put it in the root. Make sure you customise it as Chris suggested to suit your needs. If you're unsure about this, search these forums as there are several threads about robots.txt files.

 

[1BJK903]

Thanks guys.