XF 1.4 Robots.txt Recommendations

[kingjavo]

Is there an example of a robots.txt file that I could use to get me started on my site? I know it's custom, but maybe there is a default best practice configuration in place I could start with.

Also, is there any configuring in XF to set the robots file up?

 

[Paul B]

It depends on personal preferemce, what's installed, configuration and set-up, etc.
There is no 'default' file.

This is the one in use here: https://xenforo.com/robots.txt

This is the one from my own site: http://cliptheapex.com/robots.txt