disallow tags

  1. X

    Robots Disallow - Why Allow at End

    Noticed on this websites robots.txt that their disallow ended with an "Allow /" User-agent: * Disallow: /community/find-new/ Disallow: /community/account/ Disallow: /community/attachments/ Disallow: /community/goto/ Disallow: /community/posts/ Disallow: /community/login/ Disallow...
Top Bottom