XF 2.0 Can I tell search engine robots what they can and cannot index?

Not sure why you would want to do that... that's generally a bad idea for any site, forum or not.

But the only thing that comes to mind immediately is move older threads to some sort of archive forum which is not visible to Guests aka non-logged-in visitors. Search bots don't log in so if guests can't see content neither can search bots.
 
Back
Top Bottom