- Require php 7.2+
- Require XenForo 2.2+
- XF2.3 support
- Fix not reliably applying the request's robot status to various anti-robot actions
If XenForo doesn't implement this into the core, maybe @Xon you could do it in this add-on?XF\Data\Robot::getRobotUserAgents() detects 35 bots only.
This function should be replaced with CrawlerDetect or similar library, which detects 1,000's of bots/spiders/crawlers:
![]()
GitHub - JayBizzle/Crawler-Detect: 🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent - JayBizzle/Crawler-Detectgithub.com
Here is the example for one thread:
- Internal XenForo counter reports 519 views.
- In server logs seeing 903 requests. After manually removing bots from the list, there are 355 views.
- Google Analytics reports 167 views.
I understand that this add-on relies solely on XF\Data\Robot::getRobotUserAgents(), which detects 35 bots only
If XenForo doesn't implement this into the core, maybe @Xon you could do it in this add-on?
- Add
Allow bots to searchoption (default: enabled)- Add
Maximum number of search/find new results for bots(default: 50)
- This feature requires Search Improvements v2.19.0+
We use essential cookies to make this site work, and optional cookies to enhance your experience.