Known Bots 6.0.3
- Thread starter Sim
- Start date
Nirjonadda
Well-known member
Nirjonadda
Well-known member
JohnSmith002
Member
Feedly/1.0Feedly.com's crawler for locating RSS feeds and retrieving them.
Nirjonadda
Well-known member
New bots detected [3.20.0]
- mozilla/5.0 (x11; linux x86_64; rv:78.0) gecko/20100101 (inetdex bot)
- mozilla/5.0 (linux; android 10.0; spider v10) applewebkit/537.36 (khtml, like gecko) chrome/96.0.4664.92 mobile safari/537.36
Nirjonadda
Well-known member
Robru
Well-known member
Nirjonadda
Well-known member
New bots detected [3.20.0]
- mozilla/5.0 (compatible; t3versionsbot/1.0; +https://www.t3versions.com/bot)
Sim
Well-known member
Just as an update on the development of this addon - I'm almost finished with a completely new build which no longer requires me to publish new versions to get bot updates - I have built a separate application to collate and manage the bot list which then provides an API which sites can query for updates - or download a json file of bot definitions to apply updates manually.
I'm working my way through a backlog of user agents to be processed - the application currently has 905 search strings it can use to detect bot user agents, with 28 generic bots (short strings which might match multiple bots, for example "php"), and 23 "false positives" (users agents with "bot" or "spider" etc in the string but are actually user browsers - for example Cubot mobile phones).
The emails that get sent to me with new bot detections are ingested directly into my new bot management application - so it will continue to get updated as we identify new potential bots.
The 351 "unprocessed" user agents in the statistics above is the backlog of user agents identified as likely bots that I have yet to process - I've also imported some bot lists from 3rd party sources that I am working my way through.
I hope to have the new version of the XenForo addon ready for testing on my own sites shortly - with release here in the next week or so.
I'm working my way through a backlog of user agents to be processed - the application currently has 905 search strings it can use to detect bot user agents, with 28 generic bots (short strings which might match multiple bots, for example "php"), and 23 "false positives" (users agents with "bot" or "spider" etc in the string but are actually user browsers - for example Cubot mobile phones).
The emails that get sent to me with new bot detections are ingested directly into my new bot management application - so it will continue to get updated as we identify new potential bots.
The 351 "unprocessed" user agents in the statistics above is the backlog of user agents identified as likely bots that I have yet to process - I've also imported some bot lists from 3rd party sources that I am working my way through.
I hope to have the new version of the XenForo addon ready for testing on my own sites shortly - with release here in the next week or so.
Nirjonadda
Well-known member
New bots detected [3.20.0]
- mozilla/5.0 (compatible; entferbot/0.1; +https://entfer.com; +a_new_independent_search_engine
- webprosbot/2.0 (+mailto:abuse-6337@webpros.com)
- mozilla/5.0 (compatible; t3versionsbot/1.0; +https://www.t3versions.com/bot)
- mozilla/5.0 (compatible; ev-crawler/1.0; +https://headline.com/legal/crawler)
Sim
Well-known member
Hi all,
This is going to sound really silly, however i have the files from Github, however how on earth do i install it please?!
Many thanks @Sim for taking the time to create and support this!
Don't install it from GitHub - download the addon zip file from here and then upload that to your forum using the addon install process. Takes about 30 seconds.
cjwinternet
Active member
I just want to ask, is this still a maintained add-on?
Sim
Well-known member
Yes, but I'm a bit behind with updates - I've been working on an automated update process, but it's had to take a back seat while I work on other more urgent projects.
Chromaniac
Well-known member
i read the last post. just wanted to post about gptbot which is probably one of the more interesting bots to be announced in recent times. should be interesting for anyone using addon to monitor this one. cheers. probably need to find a more optimal way to track this one.
platform.openai.com
OpenAI Platform
Explore developer resources, tutorials, API docs, and dynamic examples to get the most out of OpenAI's platform.
platform.openai.com
Nirjonadda
Well-known member
Sim
Well-known member
I've got a busy schedule for the next day or so, but I'll make it a priority to try and get a new release done this weekend. When I last deployed my test version, I discovered an issue in production which prevented me from releasing it - once I've resolved that issue, I should be good to go.
Sim
Well-known member
Sim updated Known Bots with a new update entry:
KnownBots v4.0.0 - complete re-write
Read the rest of this update entry...
KnownBots v4.0.0 - complete re-write
Read the rest of this update entry...
