• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.

disallow tags

  1. X

    Robots Disallow - Why Allow at End

    Noticed on this websites robots.txt that their disallow ended with an "Allow /" User-agent: * Disallow: /community/find-new/ Disallow: /community/account/ Disallow: /community/attachments/ Disallow: /community/goto/ Disallow: /community/posts/ Disallow: /community/login/ Disallow...