You've made it well-known you don't like Cloudflare
I cannot "not like it" as I don't have enough experience with it to judge in such a way. I see it critical for a number of reasons that I've outlined often enough, one of them is them becoming close to a monpoly. One conseqence of that is that obviously attackers focus on outmaneuvering CF (which would be a good reason to go for a less prominent alternative) and secondly we have seen just this week the consequences of such a monopoly and what happens when a monopolist fails - in this case microsoft. Cf did fail, too in the past and it will for sure again in future.
Still it might be a good product and suit the needs of many. But people should make informed decisions. One of the big downsides of many forums is that people with half-decent knowledge give advice to people with no knowledge and this way often some (sometimes bad) products get hyped uncritically while other (sometimes better) solutions are not even mentioned. That is the nature of forums. However: In a technical world this is not desirable. When obvious and well known disadvantages of a solution are not mentioned even deliberately to hype the own solution this is simply disinformation. Statements like
"your .htaccess will become complicated when you want to let pass Google" when at the same time you have not even seen a .htaccess from afar (b/c otherwise you would not make such a statement) are in the same league.
You may have best intentions and it is totally fine to say that you are happy with c/f - but please: don't pretend to a networking and firewall guru that you are not. Happy if CF works for you - but all forums that I've seen that use CF end up still having 1.000 - 2.000 guests - which for me is simply not good enough, independend from any other criticisms that I may have or not and independent from wether I "like" it or not.
You have once more promoted a solution (or rather a product) w/o being asked for a problem which wasn't described comprehensively in an environment that wasn't described either and for which no desired goal was given either. Instead of asking all these things to better understand the situation and the needs you blindly fire out a strong recommendation for your favored product. The only product you know. Hyped and uncritcally only mentioning the sunniest sides. This is no advice, this is blind hyping.
your post didn't offer anything constructive to the poster.
My post went towards you, not the poster. Even if I wanted to give him advice I've not enough information to do so. His post does not even meniton if he is on shared hosting or a server. In fact I gave him helpful advice by providing a counterweight to your advertizing. Fun is: He did not even ask for advice. He told his story and shared his .htaccessrules as a potential help for others and asked one question:
Maybe someone can suggest improvements to my .htaccess and robots.txt configurations. Any feedback or suggestions are welcome!
That's it. You did not deliver that in the slightest (and obviously did not even realize that he did not ask for advice) but instead once more blindly tried to talk him into CF w/o even asking about his goals and situation.
PS: Regarding
"you hate Cloudflare and give no advice": This is probably why I wrote an overview about the most common solutions regarding bots not even two weeks ago in this very thread - including Cloudflare:
I've made the site require a login for guests, but it hasn't stopped them.
Fair as a temporary solution (and in the end the most secure way against scraping to have the site login only) but it clearly will harm your visibility in search engines very badly and also new signups.
Sorry to ask what's probably been asked a million times, but what's currently the best way to stop or discourage them?
There is no single "best way". There are various ways and which is best for you depends from your goals, your needs, your technical abilities/knowledge, the time you are willing to...