Known Bots 6.0.3

[Nirjonadda]

@Sim Potential New Bots Detected

• mozilla/5.0 (linux; android 6.0; spider v9 build/mra58k; wv) applewebkit/537.36 (khtml, like gecko) version/4.0 chrome/44.0.2403.119 mobile safari/537.36
• mozilla/5.0 (linux; u; android 6.0; spider v9 build/mra58k; wv) applewebkit/537.36 (khtml, like gecko) version/4.0 chrome/44.0.2403.119 mobile safari/537.36 opr/54.0.2254.56148

 

[Sim]

@Sim Potential New Bots Detected

• mozilla/5.0 (linux; android 6.0; spider v9 build/mra58k; wv) applewebkit/537.36 (khtml, like gecko) version/4.0 chrome/44.0.2403.119 mobile safari/537.36
• mozilla/5.0 (linux; u; android 6.0; spider v9 build/mra58k; wv) applewebkit/537.36 (khtml, like gecko) version/4.0 chrome/44.0.2403.119 mobile safari/537.36 opr/54.0.2254.56148

Those are both Android phones from Bangladesh - I'll make sure they are added to the false-positive list.

 

[MisakiTaro]

@Sim Could you please add Archive.org Bots?

 

[Nirjonadda]

New bots detected [3.18.0]

• mozilla/5.0 (compatible; swjschecketbot/1.0

 

[Sim]

mozilla/5.0 (compatible; neevabot/1.0; +https://neeva.com/neevabot)

I'm seeing this new bot across many sites - seems to be very active. It will be added in v3.19

 

[Sim]

Sim updated Known Bots with a new update entry:

v3.19.0 new bots

new false positives:

• spider v9 phone

new bots:

• 80legs.com: 80legs Crawler
• adssellerscrawler: Ads Sellers Crawler
• apesearch crawler: ApeSearch Crawler
• aportcatalogrobot: AportCatalogRobot
• bot dns-cache.fr...

Read the rest of this update entry...

 

[Sim]

@Sim Could you please add Archive.org Bots?

I already have several archive.org bots listed.

Which user agents are you seeing that aren't being detected by this addon?

 

[KevinL]

New bots detected [3.18.0]

mozilla/5.0 (compatible; newslitbot/0.1; +https://www.newslit.co)
mozilla/5.0 (compatible; spotibobot/1.0; +http://spotibo.com)

 

[Sim]

New bots detected [3.18.0]

mozilla/5.0 (compatible; newslitbot/0.1; +https://www.newslit.co)
mozilla/5.0 (compatible; spotibobot/1.0; +http://spotibo.com)

These are both in the new 3.19 release posted yesterday.

 

[Sim]

New bots detected [3.18.0]

• mozilla/5.0 (compatible; swjschecketbot/1.0

This one didn't make it into 3.19 ... but I've added it now and it will be included in the following release later in June.

 

[Nirjonadda]

New bots detected [3.19.0]

• mozilla/5.0 (compatible; swjschecketbot/1.0
• mozilla/5.0 (linux; android 10.0; spider v10) applewebkit/537.36 (khtml, like gecko) chrome/91.0.4472.88 mobile safari/537.36

 

[KevinL]

New bots detected [3.19.0]

• mozilla/5.0 (compatible; newslitbot/0.1; +https://www.newslit.co)
• mozilla/5.0 (compatible; infotigerbot/1.9; +https://infotiger.com/bot)

Not sure why newslitbot came up again. Looks like it was already on your list.

 

[Sim]

New bots detected [3.19.0]

• mozilla/5.0 (compatible; newslitbot/0.1; +https://www.newslit.co)
• mozilla/5.0 (compatible; infotigerbot/1.9; +https://infotiger.com/bot)

Not sure why newslitbot came up again. Looks like it was already on your list.

If it was already detected before you upgraded to the latest version, it will still show up in the list until the next batch of checks are made after the upgrade.

 

[Sim]

Sim updated Known Bots with a new update entry:

v3.20.0 June 2021 new bots

new bots discovered in June 2021

• btbot: BT Bot
• catchbot: Catchbot
• comodospider: Comodo SSL Spider
• deepnoc: deepnoc bot (network optimized crawling)
• dispenserbot: Dispenser Dab Solver Checklinks Bot
• epicbot...

Read the rest of this update entry...

 

[Nirjonadda]

@Sim New bots detected [3.20.0]

• mozilla/5.0 (linux; android 10.0; spider v10) applewebkit/537.36 (khtml, like gecko) chrome/91.0.4472.120 mobile safari/537.36

 

[Sim]

@Sim New bots detected [3.20.0]

• mozilla/5.0 (linux; android 10.0; spider v10) applewebkit/537.36 (khtml, like gecko) chrome/91.0.4472.120 mobile safari/537.36

Thanks - that's another false positive, the MyCell Spider v10 from Bangladesh. I've added it to the list for the next release.

 

[Nirjonadda]

New bots detected [3.20.0]

• mozilla/5.0 (linux; u; android 10.0; en-us; spider v10 build/nrd90m) applewebkit/537.36 (khtml, like gecko) version/4.0 chrome/57.0.2987.108 ucbrowser/12.12.9.1226 mobile safari/537.36

 

[Nirjonadda]

New bots detected [3.20.0]

• webprosbot/2.0 (abuse-6337@webpros.com)
• mozilla/5.0 (linux; android 10.0; spider v10) applewebkit/537.36 (khtml, like gecko) chrome/92.0.4515.131 mobile safari/537.36

 

[Kevin]

False positive? "XenForo" is showing twice, one with a host name of 'mailer.xenforo.com' coming from the US and the second with just an IP coming from Asia.

 

[Creaky]

The link for the DatForSEO Bot appears to have n extra ) on it creating an invalid URL on the current visitors page

https://dataforseo.com/dataforseo-bot)