1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

XF 1.2 How to block Google from testing area?

Discussion in 'Troubleshooting and Problems' started by Moshe1010, Jul 25, 2013.

  1. Moshe1010

    Moshe1010 Well-Known Member

    I'm trying to block Google from my testing area (open to the public due to different reasons, but not many have the direct URL to it). I need Google to enter my site since I need to play with Google Adsense. When I blocked Google with robots.txt, I couldn't see any AdSense on my testing area, and therefore couldn't adjust them to my needs.

    Is there a way to let Google to enter my testing area (which is on a sub-domain), but not letting it to index threads/messages?
  2. RoldanLT

    RoldanLT Well-Known Member

    User-agent: Mediapartners-Google
    User-agent: *
    Disallow: /testing_area/
  3. RoldanLT

    RoldanLT Well-Known Member

    Allow google adsense

    Dis-allow all other bots
    Moshe1010 likes this.

Share This Page