Known Bots

Known Bots 3.20.0

No permission to download
new bots discovered in June 2021
new false positives:
  • spider v9 phone
new bots:
new false positives:
  • cubot; j5
  • baiduboxapp
new bots:
  • 200pleasebot
  • a8bot
  • abilogicbot
  • acoonbot
  • adform robot
  • arhpostbot
  • atomseobot
  • awariorendererbot
  • badoobot
  • bl.uk_ldfc_bot
  • brobot
  • charityengine bot
  • charlotte
  • cosmos
  • coveobot
  • crawlbot/1.0.0
  • cxensebot
  • facebot
  • fandomopengraphbot
  • freshpingbot
  • fuelbot
  • geedobot
  • getlocalbot
  • google-safety
  • gpcsupbot
  • grub-client
  • gynxbot
  • healrworld crawler
  • hgfalphaxcrawl
  • hoodle crawler
  • idmarch automatic
  • imrbot
  • jambot
  • justlocal.nl
  • kantarsifomediaauditbot
  • keobsbot
  • keybasebot
  • koepabot
  • lanaibot
  • landsbokasafn
  • lapozzbot
  • linkpulse metacrawler
  • linksmanager.com_bot
  • lxrbot
  • mbot v
  • moreoverbot
  • netpeakspiderbot
  • www.niraiya.com
  • node/simplecrawler
  • nu.marginalia.wmsa.edge-crawler
  • nutchcvs
  • oer commons bot
  • omniexplorer_bot
  • onefuncbot
  • oozbot
  • pickybot
  • piepmatz bot
  • plukkie
  • pu_in crawler
  • punkspider
  • pwa-crawler
  • reasonalbot
  • revuebot
  • runet-research-crawler
  • screenerbot crawler
  • searchenginecrawler
  • sebot-wa
  • seekbot
  • shopwiki
  • showyoubot
  • siteauditbot
  • sitescorebot
  • spinn3r
  • squirrobot
  • ssl-crawler
  • thinkbot
  • tsmbot
  • tweetedtimes bot
  • ucrawl
  • umichbot
  • urlappendbot
  • verticalleap-sitestatusbot
  • webgraph
  • weblinkchecker
  • websquash.com
  • wellknownbot
  • wizenozebot
new false positives:
  • cubot r11
  • spider v7 build/lmy47i
  • spider v7 (MyCell Spider v7 from Bangladesh)

weekly bot updates:
  • adbot/1.0
  • ahrefssiteaudit
  • amazonadbot
  • amg-bot
  • ampxfbot
  • anybot
  • aranea web-crawled corpora project
  • backlinkcrawler
  • botelaire
  • chirpyhubbot
  • cookiebot
  • crawl/1.0
  • dataforseobot
  • diffeobot
  • digitalshadowsbot
  • discoverbot
  • dmasslinksafetybot
  • domcopbot
  • echocrawl
  • emeraldshield.com webbot
  • historyspider
  • iplogger crawler
  • mohawk crawler
  • mtrobot
  • mxbot
  • netresearchserver
  • openindexspider
  • pinllc search robot
  • rustbot
  • sellers.guide crawler by primis
  • snaplocalbot
  • test-deep-cocrawler
  • vdo.ai bot
  • wesee:search
  • whizebot
  • xaldon_webspider
  • xovibot
  • yaanibot
  • yelpbot
weekly new bots:
  • boitho.com-dc
  • msc crawl project radboud university
  • niocbot
  • open web analytics bot
  • quetextbot
  • rc-crawler
  • tokenspider
  • womlpefactory
  • yeti/1.0
  • new Dinobot Android TV false positives:
    • dinobot 4k plus
  • weekly new bots:
    • cis455crawler
    • crystalsemanticsbot
    • discoverspider
    • envolk[its]spider
    • geograph linkcheck bot
    • gg peekbot
    • iccrawler
    • mybot
    • psbot
    • suggybot
    • testbot
weekly new bots:
  • antbot/1.0
  • becomebot
  • castlebot
  • custom-crawler
  • feedsearch bot
  • gulper web bot
  • istellabot
  • lmspider
  • marketingminer bot
  • my nutch spider
  • networking4all bot
  • nfwebcrawler
  • tombapublicwebcrawler
  • uptimebot
  • vuhuvbot
  • webcrawl.net
  • webspider 1.0
new Cubot phone false positives:
  • cubot a5
  • cubot j3 pro
weekly new bots:
  • addsugarspiderbot
  • annuairefrancais.fr
  • coibotparser
  • criteobot
  • discobot
  • domainspider-bot
  • dropboxpreviewbot
  • dumbot
  • gnowitnewsbot
  • hoaxybot
  • ichiro
  • lamarkbot
  • media-bot
  • nusearch spider
  • radian6_default_
  • xovionpagecrawler
  • zyborg
weekly new bots:
  • experiancrawluk
  • impact radius compliance bot
  • kauaibot
  • leuchtfeuer crawler
  • redirectbot
  • simpleanalyticsbot
  • skimbot
  • sogou pic spider
  • testcrawler
weekly new bots:
  • girafabot
  • googebot malware scanning
  • i-market-bot
  • intelx.io_bot
  • ninjabot
  • pywebcopybot
  • serpstatbot
  • supremesearch.net
  • todoexpertosbot
  • webmoney megastock robot
  • wordchampbot
  • xaldon webspider
  • yesslebot
Top