Users are reporting similar issues here, Maximum mention alerts is set to 5, user is tagging just 1 person. That person has notifications on for mentions.
In his notifications there is only 1 entry that a new reply was made to a thread he is following, no notification about the fact that he has been mentioned in that reply. I verified with the poster and he did not add the mention through editing.