If you soft delete content, then any alerts will definitely stay -- the post still exists, you just may not be able to see it. However, the alert does a permission check so you will only see the alert if you can still see the post. (The unread alert count not being exact is an acceptable trade off.)
