I have found various threads on here about robots.txt and robots=noindex, but have been unable to work out what to do for my situation. I run a forum with half a dozen sub-forums, and one of these contains information that a significant number of members do not want to be indexed by search engines as it contains financial information. Because it is such an issue I tried to block that specific sub forum with a robots.txt disallow on that sub-thread, but that clearly is not working - threads within it are still being indexed.
Is there a way to allow indexing of 5 sub-forums and their threads, while blocking indexing of 1 sub-forum and its threads, and if so, can someone describe how it is done?
Thanks, but that doesn't stop search engines indexing as far as I can see? This particular forum already requiress registered users to apply for an extra permission, but seems to still be indexed by Google and other search engines.
Brogan, can you say exactly what you mean by "removing access for guests"? In permissions for this node I had allowed all registered AND unregistered users to view it, but to post or reply you have to be registered and ask to be added to special sub-group that has permission to post. If I now change this to deny view access to the 'unregistered/uncomfirmed' group, will that acheive want I want? Or do I have to do something else? Many thanks again.