Known Bots

Known Bots 3.17.0

No permission to download
new false positives:
  • cubot r11
  • spider v7 build/lmy47i
  • spider v7 (MyCell Spider v7 from Bangladesh)

weekly bot updates:
  • adbot/1.0
  • ahrefssiteaudit
  • amazonadbot
  • amg-bot
  • ampxfbot
  • anybot
  • aranea web-crawled corpora project
  • backlinkcrawler
  • botelaire
  • chirpyhubbot
  • cookiebot
  • crawl/1.0
  • dataforseobot
  • diffeobot
  • digitalshadowsbot
  • discoverbot
  • dmasslinksafetybot
  • domcopbot
  • echocrawl
  • emeraldshield.com webbot
  • historyspider
  • iplogger crawler
  • mohawk crawler
  • mtrobot
  • mxbot
  • netresearchserver
  • openindexspider
  • pinllc search robot
  • rustbot
  • sellers.guide crawler by primis
  • snaplocalbot
  • test-deep-cocrawler
  • vdo.ai bot
  • wesee:search
  • whizebot
  • xaldon_webspider
  • xovibot
  • yaanibot
  • yelpbot
weekly new bots:
  • boitho.com-dc
  • msc crawl project radboud university
  • niocbot
  • open web analytics bot
  • quetextbot
  • rc-crawler
  • tokenspider
  • womlpefactory
  • yeti/1.0
  • new Dinobot Android TV false positives:
    • dinobot 4k plus
  • weekly new bots:
    • cis455crawler
    • crystalsemanticsbot
    • discoverspider
    • envolk[its]spider
    • geograph linkcheck bot
    • gg peekbot
    • iccrawler
    • mybot
    • psbot
    • suggybot
    • testbot
weekly new bots:
  • antbot/1.0
  • becomebot
  • castlebot
  • custom-crawler
  • feedsearch bot
  • gulper web bot
  • istellabot
  • lmspider
  • marketingminer bot
  • my nutch spider
  • networking4all bot
  • nfwebcrawler
  • tombapublicwebcrawler
  • uptimebot
  • vuhuvbot
  • webcrawl.net
  • webspider 1.0
new Cubot phone false positives:
  • cubot a5
  • cubot j3 pro
weekly new bots:
  • addsugarspiderbot
  • annuairefrancais.fr
  • coibotparser
  • criteobot
  • discobot
  • domainspider-bot
  • dropboxpreviewbot
  • dumbot
  • gnowitnewsbot
  • hoaxybot
  • ichiro
  • lamarkbot
  • media-bot
  • nusearch spider
  • radian6_default_
  • xovionpagecrawler
  • zyborg
weekly new bots:
  • experiancrawluk
  • impact radius compliance bot
  • kauaibot
  • leuchtfeuer crawler
  • redirectbot
  • simpleanalyticsbot
  • skimbot
  • sogou pic spider
  • testcrawler
weekly new bots:
  • girafabot
  • googebot malware scanning
  • i-market-bot
  • intelx.io_bot
  • ninjabot
  • pywebcopybot
  • serpstatbot
  • supremesearch.net
  • todoexpertosbot
  • webmoney megastock robot
  • wordchampbot
  • xaldon webspider
  • yesslebot
weekly new bots:
  • aasa-bot
  • amazon-advertising-ad-standards-bot
  • crawler/0.0.1
  • danibot
  • dragonbot
  • irlbot
  • jooblebot
  • ldspider
  • linkisbot
  • mohawk-crawler
  • newsgator
  • ottobot
  • pigafetta
  • pingdom.com_bot
  • planckspider
  • rss bot
  • speedy spider
  • summalybot
  • virusdie crawler
weekly new bots:
  • earwigbot
  • fess
  • metadata-downloader-bot
  • page audit bot
  • plurkbot
  • r6_commentreader
  • r6_feedfetcher
  • sc_bot
  • tkbot
  • willie irc bot
weekly new bots:
  • ag_dm_spider
  • aihitbot
  • avocetcrawler
  • b2b bot
  • checkbot
  • em-crawler
  • feedsearch-crawler
  • fullstorybot
  • krzana-rss-bot
  • mediacloud bot for open academic research
  • mlbot
  • niuebot
  • ocarinabot
  • prft-bot
  • qwantbot
  • rasabot
  • riverbot
  • rytebot
  • sabsimbot
  • scribbr-citation-bot
  • seodiver
  • snapbot
  • solomonobot
  • temeliobot-keyword-scrapper
  • vsusearchspider
  • your-search-bot
Top