I did this simply by carefully setting-up all of my forum permissions. Certain user groups are not allowed to view the member's list, and given that most of my nodes are private, groups can only see the nodes they are permitted to see. I think I have one subfourm where members from separate group can interact, and that is a General Discussion area.