Crazy amount of guests

[Kirby]

Give PHP more capacity and ensure the DB is well tuned. Problem solved.

I am a bit curious:
How would this solve the problem that AI crawlers feed their models with knowledge from our forums and thus drive away potential visitors to their services without generating revenue (like human visitors would)?

 

[Levina]

Did you try to do anything about it since you started the thread back in October last year?

As you may remember I'm on Cloud hosting so my choices are limited and I still don't want to switch to Cloudflare.

What I did in the past was use discourage mode. But if I put too many IP addresses in there it would throttle the site and eventually grind to a halt.

The error I made with that was to have cranked every setting up to 100%. So then I made some changes. I turned off everything except the redirect, which I set to 100%. Some still get through just by sheer volume, but it's minor and the site doesn't affect the site now. So this works for me.

But not when I have 12k bots all with different IP addresses. If I were smart I would get us on Cloudflare where I could probably block an entire ASN? But these bot swarms don't seem to stay long and they don't throttle the site.