• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.

XF 1.2 Robots.txt recommendations

I noticed that google is recording each post URL, for example Post #60 permalink, post #72 permalink. On my SMF site, I disallowed individual posts, so each page is captured.

Anyone have recommendations for a good robots.txt for XF?