The problem with deleting a spammer is they're then free to sign up again with a different email address, and you'll lose their IP address history so they'd be able to re-register with the same IP address without being flagged.
We actually have gone with an approach where users awaiting approval are no longer deleted either, for similar reasons. Instead they are marked as rejected, and it prevents them doing repeat sign ups.