I also had this issue, but I resolved it by finding his user id in the group_relations in the database and removed those entries. (edit: relating to the group in question)
Under his username in the database it did not show the secondary group as moderator.
I am gathering this is why the...