Known Bots 6.0.3

[Sim]

            $mail->setContent(
                "New bots detected",
                "<ul>" . PHP_EOL . $botList . PHP_EOL . "</ul>" . PHP_EOL
            );

Can you make «New bots detected» a translatable phrase?

This has been coded - will be included in v3.3.0 which I'll probably release early next week once the next batch of newly detected bots gets processed

 

[Sim]

@Sim Request for feature:

This may need to be a separate addon but having identified bots you don't need or want having an option to click in the list to auto-ban them, either by user agent or by IP, would be excellent.

Will add it to the suggestion list for future consideration.

I was thinking as part of this that it might be useful to build a tool that can generate a robots.txt file to block bots you don't want.

 

[Sim]

@Sim New bots detected.

• wp.com feedbot/1.0 (+https://wp.com)
• mozilla/5.0 (compatible; surdotlybot/1.0; +http://sur.ly/bot.html)
• mozilla/5.0 (compatible; adsbot/3.1)
• mozilla/5.0 (compatible; nimbostratus-bot/v1.3.2; http://cloudsystemnetworks.com)
• mozilla/5.0 (compatible; duckduckgo-favicons-bot/1.0; +http://duckduckgo.com)

These are all included in v3.2.0 released today

 

[Sim]

• mozilla/5.0 (compatible; vkrobot/1.0)

Thanks - this one will be included in v3.3.0 which I expect to release early next week

 

[Sim]

Will the email field accept multiple email addresses? I'd like to send it to myself as well as you without manually forwarding it.

Not at this point in time, no.

Can I suggest you have it emailed to yourself and you set up a mail rule to forward these emails to me when you receive them? That will solve the problem for you.

 

[djbaxter]

I was just looking at this - your example was not accurate, since the "Total" includes members and guests only and robots are excluded, which is why I put them on a separate line:


Also - if I include the robot count in the brackets, the default sidebar width means that the line will wrap:
View attachment 233990

I figured it was more appropriate to list robots on a separate line.

I agree.

 

[Crash Test]

A member of our team wrote a small manual. I'll post it later.

https://uh-team.com/resources/blocking-robots-on-the-nginx-side.11/

 

[Nirjonadda]

New bots detected:

• germcrawler
• mozilla/5.0 (compatible; adsbot/3.1)
• mozilla/5.0 (compatible; nimbostratus-bot/v1.3.2; http://cloudsystemnetworks.com)
• mozilla/5.0 (compatible; google/2.1; +http://www.google.com/bot.html)
• adstxtlab.com crawler

 

[Mouth]

A member of our team wrote a small manual. I'll post it later.

https://uh-team.com/resources/blocking-robots-on-the-nginx-side.11/

I use https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker
It's FANTASTIC!

 

[Sim]

mozilla/5.0 (compatible; google/2.1; +http://www.google.com/bot.html)

That's a curious one. There is no official Google bot with this user agent - but there is one which contains Mediapartners-Google/2.1 or Googlebot/2.1

I'm wondering if this is something new from Google - or if it is something spoofing one of the Google bots?

 

[Crash Test]

mozilla/5.0 (compatible; seokicks; +https://www.seokicks.de/robot.html)
tpradstxtcrawler/1.0

 

[Sim]

Sim updated Known Bots with a new update entry:

v3.3.0 even more new bots

v3.3.0 updates:

• added a phrase for email subject instead of hardcoding the string
• removed Dalvik from list of bots - it's an Android browser
• fixed missing user agent string for rssingbot
• new Cubot phone false positives
  • cubot echo
  • cubot_j3
  • cubot king kong
  • cubot max
  • cubot note plus
  • cubot_note_s
  • cubot_note_s build/mra58k
  • cubot_nova
  • cubot r9
  • cubot_x18_plus
• lots of new bots
  • adstxtlab.com
  • anderspinkbot...

Read the rest of this update entry...

 

[Sim]

mozilla/5.0 (compatible; seokicks; +https://www.seokicks.de/robot.html)
tpradstxtcrawler/1.0

Both of these were included in v3.3.0 which was released today

 

[Nirjonadda]

I use https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker
It's FANTASTIC!

How to using this in cPanel?

 

[Matthew S]

How to using this in cPanel?

I've been a long time away from cpanel - do they support nginx now?

 

[Nirjonadda]

I've been a long time away from cpanel - do they support nginx now?

Yes, cPanel support Nginx on a server.

cPanel Nginx Support · Issue #380 · mitchellkrogza/nginx-ultimate-bad-bot-blocker

cPanel now Support install Nginx on a server that runs cPanel & WHM and EasyApache 4. Does any one using nginx (cPanel) with NUBBB? Also How you are installed nginx ultimate bad bot blocker on cPan...

github.com

 

[Sim]

Sim updated Known Bots with a new update entry:

v3.4.0 weekly bot updates

• update: email subject line now includes addon version
• feature: now optionally uses Monolog Logging Service addon for logging info about sent emails
• fixed missing mailto: in some email links
• new Cubot phone false positives:
  • cubot h3
  • cubot_note_s build/lmy47i
• weekly new bots:
  • 3dd trunk
  • 3w24bot
  • auto spider
  • aylien
  • bidswitchbot
  • bnf.fr_bot...

Read the rest of this update entry...

 

[Crash Test]

In phrase
hampel_knownbots_online_now_x_robots

is not needed  

 

[Crash Test]

Maybe it was, but here is:

• mozilla/5.0 (linux; u; android 4.2.2; xx; glx spideri build/jdq39) applewebkit/534.30 (khtml, like gecko) version/4.0 mobile safari/534.30 mxbrowser/4.3.8.2000 maxthon/4.3.8.2000
• safednsbot (https://www.safedns.com/searchbot)
• mozilla/5.0 (compatible; statonlinerubot/1.0)
• webzip/3.5 (http://www.spidersoft.com)
• superbot/4.4.0.60 (windows xp)

 

[Sim]

Sim updated Known Bots with a new update entry:

v3.5.0 weekly bot updates

• new Cubot phone false positives:
  • cubot magic
  • cubot_manito
  • cubot_power
• simplify seokicks-robot match to just seokicks to catch new bot user agent
• weekly new bots:
  • applenewsbot
  • bl.uk_lddc_bot
  • dcrawl
  • dy robot
  • ezlynx
  • fast-webcrawler
  • gdark-spider
  • gethpinfo.com-bot
  • gowikibot
  • image size by siteimprove.com
  • linkcheck by siteimprove.com
  • loaderio;verification-bot
  • pingdompagespeed
  • pmoz.info odp link checker...

Read the rest of this update entry...