The option only affects registrations made after you have set this. Any before that won't have Receive email when a new conversation message is received ticked for those users, unless they have chosen to change it.
Again as I said, even now you have this option set in the ACP, new users can still until it in their profile.