Crazy amount of guests

I'm experience this right now with 37K guests and I have cloudflare Pro plan with all the AI Bot turned on.
The server load is extremely high and bouncing around 100 where normal load would be 1-2.
I see the mariadbd server has very high load with 488 %CPU.
I tried to restart the sql server, etc but it does not help at all.

Any advice?
 
Andy.N said:
I'm experience this right now with 37K guests and I have cloudflare Pro plan with all the AI Bot turned on.
The server load is extremely high and bouncing around 100 where normal load would be 1-2.
I see the mariadbd server has very high load with 488 %CPU.
I tried to restart the sql server, etc but it does not help at all.

Any advice?
Click to expand...
serve static pages to guests
 
digitalpoint said:
Yes, because when a page is cached, the request doesn't even need to go to your origin server, it's served to the user (or bot) directly from Cloudflare's closest data center. It's kind of the point (at least partially).
Click to expand...
I updated the addon to the latest version, config it with an API. The load still not budging from 100 with 35K guests onsite.
Is there a magic button somewhere that I can add to help deal with this?
 
digitalpoint said:
Enable the option to cache pages for guests (under Admin -> Cloudflare -> Edge caching).

View attachment 330760
Click to expand...
Oh yeah baby!!!
You save the day, Shawn. Thanks very much.
The load is from 100+ is dropping to single digit now.
So this means without this edge caching offered by this addon, the 40K guests (mostly AI crawlers) would hammer my server all day long.
I also guess that simply turn on Anti-bot feature from Cloudflare would not do much.
 
consistently 2-3k guests here on fail2ban lately.
the secret sauce is good banlists :)

Glad you found an answer btw, that's a record amount of guests i've heard of on any site
 
Andy.N said:
Oh yeah baby!!!
You save the day, Shawn. Thanks very much.
The load is from 100+ is dropping to single digit now.
So this means without this edge caching offered by this addon, the 40K guests (mostly AI crawlers) would hammer my server all day long.
I also guess that simply turn on Anti-bot feature from Cloudflare would not do much.
Click to expand...
Yep, and good bots (like Googlebot) as well as people finding your site via search (unregistered users) should see significantly faster load times since they are just being fed the content from geographically closer places (Cloudflare data centers). A single location on earth (your origin server) can be 20,000km away from the user and potentially traversing a zillion different networks/hops. Having the page cached 50 or 100km from users is going to always be faster.

Try browsing around your own site with Incognito to test it.

...but also can free up resources of your server that no longer needs to render every page request in full.
 
You must log in or register to reply here.

Similar threads

O
  • Question Question
XF 2.2 Huge amount of guests
Replies
6
Views
136
infinitysnapz
infinitysnapz
Wildcat Media
Unusually high number of guests (4x to 5x normal)
Replies
8
Views
180
Tumpe
Tumpe
ibrian
  • Question Question
XF 2.3 How to reduce amount of content quoted from linked to article?
Replies
2
Views
41
ibrian
ibrian
FoP
And explosion of 3,064 "guests" !!
Replies
11
Views
241
FoP
FoP
drastic
Add-on Seeking dev to create RSS importer that limits characters and amount of feeds imported at once
Replies
1
Views
188
drastic
drastic
Back
Top Bottom