XF 1.4 Robots.txt Recommendations


Active member
Is there an example of a robots.txt file that I could use to get me started on my site? I know it's custom, but maybe there is a default best practice configuration in place I could start with.

Also, is there any configuring in XF to set the robots file up?