I was able to resolve the bug showing all usergroups the mod option to force a user to re-confirm rules:
Admin -> Appearance -> Template Modifications -> search "member_view":
For our use case, simply disabling the edit from Advanced Rules was enough as I don't see us using that feature...