I have found various threads on here about robots.txt and robots=noindex, but have been unable to work out what to do for my situation. I run a forum with half a dozen sub-forums, and one of these contains information that a significant number of members do not want to be indexed by search engines as it contains financial information. Because it is such an issue I tried to block that specific sub forum with a robots.txt disallow on that sub-thread, but that clearly is not working - threads within it are still being indexed.
Is there a way to allow indexing of 5 sub-forums and their threads, while blocking indexing of 1 sub-forum and its threads, and if so, can someone describe how it is done?
Many thanks for your help
Is there a way to allow indexing of 5 sub-forums and their threads, while blocking indexing of 1 sub-forum and its threads, and if so, can someone describe how it is done?
Many thanks for your help