Crazy amount of guests

Never really tried that route, i generally work in root-level management, not user-level management. :D
I used managed hosting myself a long time ago, and having root access was so freeing, although when I switched over it meant a few sleepless nights, worrying about getting hacked into. (A large forum I took over for was hacked at one point, but that was the early 2000s.)

I eventually got everything so buttoned up (along with killing off many sites that weren't being used) that I don't need to worry about it much. Like having two firewalls--the host has one, as do my servers, so if for some reason my rules ever fail I can fall back on theirs. At the moment I run Elasticsearch and MariaDB each on separate servers, and only access them via the local network at the host--the only IPs open to the public are 1) my own IP address and 2) the IP address of a server at a different host, so I always have a backdoor.
 
if you don't have members outside of Germany then blocking the rest of the world is one option.
For the most part a really bad idea. Except if your users never travel outside Germany.
However you have probably blocked Google and various other SEO bots, possibly some vpn users, and any payment callback providers.
Absolutely no issue to create rules for that.
In Cloudflare, you can also countries and that blocks them before they reach the server. Blocking in .htaccess means the requests still hit the server before being blocked.
Once more you are mixing up a lot of things pretty badly. In this case architecture, functionality and products. To block traffic before it reaches your server is architecture. In olden times we would have called that "having a bastion host". You don't need Cloudflare for that.
In Cloudflare, it could also be more fine tuned. Eg you can whitelist verified bots like google, bing etc and can block certain countries or just challenge others where you might have guests or members from.
This is functionality, in this case a mixture of features of a firewall and a authenticating (and potentially caching) proxy. Once more absolutely no need for Cloudflare to achieve that.
You can probably whitelist verified bots in .htaccess as well but that could make .htaccess more complicated.
Obviously every rule makes the ruleset more complicated. That is no different between .htaccess and Cloudflare. It is pretty trivial to add these rules to .htaccess and makes it in no way complicated.
It would mean setting up a free account in Cloudflare and having your dns go through there. It's not a big job.
And here we go again: If the only took you now is a hammer you recommend it als the only tool to everyone and if you only have a hammer everything looks like a nail. Cloudflare is the solution for all and everyhing. :rolleyes: The world of tools is bigger than that. No mentioning of the downsides, no mention of alternatives not even asking if Cloudlare could be an option at all, just blindly recommending a product. As said often enough in this thread: They do offer a product that fits many needs but they are by far not the only ones, they are not the only way of doing it and they do have their downsides. Ignoring all that again and again destpite, after it being mentioned countless times, is nothing but ignorance and everything but helpful.
 
My response was to @darkeye. You've made it well-known you don't like Cloudflare @smallwheels but plenty of other people do and for the reasons given. This isn't your forum and you're not the moderator - so we are all free to reply to others. Indeed most forums ask posters to keep it friendly and not personal or critical. I think undermining those suggestions doesn't help the poster asking for information, and particularly as your post didn't offer anything constructive to the poster.
 
You've made it well-known you don't like Cloudflare
I cannot "not like it" as I don't have enough experience with it to judge in such a way. I see it critical for a number of reasons that I've outlined often enough, one of them is them becoming close to a monpoly. One conseqence of that is that obviously attackers focus on outmaneuvering CF (which would be a good reason to go for a less prominent alternative) and secondly we have seen just this week the consequences of such a monopoly and what happens when a monopolist fails - in this case microsoft. Cf did fail, too in the past and it will for sure again in future.
Still it might be a good product and suit the needs of many. But people should make informed decisions. One of the big downsides of many forums is that people with half-decent knowledge give advice to people with no knowledge and this way often some (sometimes bad) products get hyped uncritically while other (sometimes better) solutions are not even mentioned. That is the nature of forums. However: In a technical world this is not desirable. When obvious and well known disadvantages of a solution are not mentioned even deliberately to hype the own solution this is simply disinformation. Statements like "your .htaccess will become complicated when you want to let pass Google" when at the same time you have not even seen a .htaccess from afar (b/c otherwise you would not make such a statement) are in the same league.
You may have best intentions and it is totally fine to say that you are happy with c/f - but please: don't pretend to a networking and firewall guru that you are not. Happy if CF works for you - but all forums that I've seen that use CF end up still having 1.000 - 2.000 guests - which for me is simply not good enough, independend from any other criticisms that I may have or not and independent from wether I "like" it or not.
You have once more promoted a solution (or rather a product) w/o being asked for a problem which wasn't described comprehensively in an environment that wasn't described either and for which no desired goal was given either. Instead of asking all these things to better understand the situation and the needs you blindly fire out a strong recommendation for your favored product. The only product you know. Hyped and uncritcally only mentioning the sunniest sides. This is no advice, this is blind hyping.
your post didn't offer anything constructive to the poster.
My post went towards you, not the poster. Even if I wanted to give him advice I've not enough information to do so. His post does not even meniton if he is on shared hosting or a server. In fact I gave him helpful advice by providing a counterweight to your advertizing. Fun is: He did not even ask for advice. He told his story and shared his .htaccessrules as a potential help for others and asked one question:

Maybe someone can suggest improvements to my .htaccess and robots.txt configurations. Any feedback or suggestions are welcome!
That's it. You did not deliver that in the slightest (and obviously did not even realize that he did not ask for advice) but instead once more blindly tried to talk him into CF w/o even asking about his goals and situation.

PS: Regarding "you hate Cloudflare and give no advice": This is probably why I wrote an overview about the most common solutions regarding bots not even two weeks ago in this very thread - including Cloudflare:

 
Earlier in this thread, Cloudflare was a fairly major recommendation from many people, not just myself. And it can hardly fail with a hard block!!! Challenges aren't foolproof but a block is a block - at the edge, before it reaches the server. Within that block it can whitelist verified bots, such as search engines, and registered members. Which could be useful if a member happens to be visiting another country.

I am aware of some other products and own another one but haven't needed it. But yes Cloudflare works well for me and keeps the bots out without restricting most real people.
 
Last edited:
Earlier in this thread, Cloudflare was a fairly major recommendation from many people, not just myself.
It still is, obviously.
And it can hardly fail with a hard block!!!
You don't need CF for that and while I agree regarding the benefits of a hard block (and use this massively) quite a lot of people here in this thread have a way different opinion regarding that.
at the edge, before it reaches the server.
Once mor you mixing things up. What exactly is "the server"? The computer? a virtual machine? Firewall? Apache/Nginx? XenForo? Which of these comes to it's limit under which conditions and why? If none of them do you don't need to filter at CF. It you can't answer the question better make your homework before creating a more complex setup. "The edge" is btw. not necessarily CF, it simply is the furthest out part of your setup, as far away from your application as possible. It may simply be the firewall on your server itself or another host close to it. We are in technical debate where words have a meaning. Mixing those meanings up by blindly repeating words causes confusion and disinformation.
The advantage of CF is that it is a CDN like other CDNs, too (so can migitate load through caching) and (as others) has filtering options, so can in sum protect against DDOS (which has become a rarity today but some bot waves seem to have similar effects). If you don't need that there is no need for CF. You can still use it to as kind of an insurance to fire it up in case a nasty huge wave hits you - however you do pay a price for that through a more complex setup.
Within that block it can whitelist verified bots, such as search engines, and registered members. Which could be useful if a member happens to be visiting another country.
Again: You don't need CF for that in the slightest.

BTW: What you completely ignored in your praise for CF: The OP is and probably hosts in Germany. Germany's biggest internet provider for end users is DTAG. DTAG has no direct peering with CF due to DTAG's arrogant peering policy. Which means: In certain situations using CF can be counterproductive if your main user base is in Germany. Pretty important aspect for the poster, isn't it?

Again: I don't say that CF would be a bad option in general or not a potential option for the poster. It just makes absolutely no sense to give flat out advice in complete ignorance or lack of knowlege of the situation, environment and goals of the one having the problems. Depending from that CF may be advisable or not.
 
Last edited:
I just checked that and it changed in September this year and they now have a partnership. But yes GDPR would apply in terms and privacy notices/cookie notices, but apparently Cloudflare deals with the agreement automatically. Storing of IP addresses can be an issue with GDPR whatever method is used.

 
Back
Top Bottom