Claudebot - Thousands of Hits

[alexm]

Just in case you didn't see this, in recent weeks suddenly...

Added to robots.txt:

User-agent: anthropic-ai
Disallow: /

It seems to obey the rules with robots.txt at this moment in time, so that is one solution.

Regards,

Alex

 

[philmckrackon]

Also, if it stops obeying robots.txt. Add this to the .htaccess file.

BrowserMatchNoCase "anthropic-ai" bad_bot
Order Deny,Allow
Deny from env=bad_bot