Their (often spammy) username is taken, and can't be used by another member. They can't register again, using the same email address. Users who attempt to register using the same IP as a banned member will be sent to the approval queue.
In XF2 we've actually introduced a new status, "Rejected". This is actually going to be used instead of deletion when you reject users from the approval queue (for the same reasons as above).