XF 2.0 Can I tell search engine robots what they can and cannot index?

[Spartan]

I'd like to limit them to only the past month.

 

[djbaxter]

Not sure why you would want to do that... that's generally a bad idea for any site, forum or not.

But the only thing that comes to mind immediately is move older threads to some sort of archive forum which is not visible to Guests aka non-logged-in visitors. Search bots don't log in so if guests can't see content neither can search bots.

 

[jeb35]

Yeah I agree that's not a very good idea.