alexm Active member Apr 2, 2024 #1 Just in case you didn't see this, in recent weeks suddenly... Added to robots.txt: Code: User-agent: anthropic-ai Disallow: / It seems to obey the rules with robots.txt at this moment in time, so that is one solution. Regards, Alex Last edited: Apr 3, 2024
Just in case you didn't see this, in recent weeks suddenly... Added to robots.txt: Code: User-agent: anthropic-ai Disallow: / It seems to obey the rules with robots.txt at this moment in time, so that is one solution. Regards, Alex
philmckrackon Active member Apr 3, 2024 #2 Also, if it stops obeying robots.txt. Add this to the .htaccess file. Code: BrowserMatchNoCase "anthropic-ai" bad_bot Order Deny,Allow Deny from env=bad_bot
Also, if it stops obeying robots.txt. Add this to the .htaccess file. Code: BrowserMatchNoCase "anthropic-ai" bad_bot Order Deny,Allow Deny from env=bad_bot