I don't feel disturbed by those remaining alerts, I just thought this might be a bug.
It can also be intentional, in a way that alerts are stored in a different way or table and those alerts don't even know that I opted out because they are not connected. In this case it would be a lot harder to remove them versus leaving them where they are. Does it make sense?