Crazy amount of guests

[smallwheels]

Holy crap, last couple of days/weeks I had about 8k visitors (scrapers) but today that was 32+k

That's quite a bunch! I usually have 2-2,5k of which about 1k come trough. Yesterday evening it were however 4,8k, so once more a bit of a wave seems to go on. I don't care as still 1k came through and the rest was deflected by ASN- and country-blocking and the checks of proxycheck.io.

The forum here is also a pretty good indicator most of the time. At the moment 31 users and 15k guests:

 

[Suzanne O]

Just had to go into my hosting account and block a few ip addresses from trolls and bots

 

[Anthony Parsons]

Not having the issue now, after tuning CF to previous posts.

 

[ES Dev Team]

You need ASN blocks / a better logic engine to do better.
The amount of bots has definitely ticked up in the last week or so and i've had to periodically go in and block ASNs/some networks


I thought of something recently.
People using USA residential proxies are probably located in Asia.
It's possible that the requests to these residential proxies complete in a much longer time than usual vs what you'd expect in the USA.

Apache or Nginx could log the total transmit time and you could write something to periodically analyze those logs and tally up what % of the times went slow ( just in case someone's on wifi which periodically glitches out ) vs went about the average for USA connections and start profiling from there.

If not, there is probably some latency fingerprinting that could be done but that's more complex to pull off.

I'm not pissed off enough to do this computer science experiment yet.