“No” is essentially “not set”.
If they’re all set to no then the users won’t have any more custom permissions and they won’t appear in the list.
If they are still there then it means you have orphaned permission values. This may be from an add on or similar.