This is down to the IP resolution being slow, usually from spammers. The most recent 1.4 release changes to not resolve the IPs for this reason. Short of upgrading to that, you need to identify the users via a search (based on their user state) and adjust their user state/delete them as necessary.