1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Prevent Google from Indexing Site-How?

Discussion in 'XenForo Questions and Support' started by Kenneth Holland, Sep 17, 2012.

  1. Kenneth Holland

    Kenneth Holland Active Member

    Hi,

    I'm testing my XF site right now and I don't want Google indexing my site until I launch. Is there any simple way I can restrict this without having to mess with the .htaccess?

    Thanks! :)

    Ken
     
  2. Steve F

    Steve F Well-Known Member

    robots.txt

    Add

    Code:
    User-agent: *
    Disallow: /
     
    Kenneth Holland likes this.
  3. Kenneth Holland

    Kenneth Holland Active Member

    Qwk,

    Is there a separate robots.txt file in XF installation. Haven't found it.

    Ken
     
  4. Steve F

    Steve F Well-Known Member

    Just create a txt file naming it robots.txt and upload to your root directory.

    Edit: Already had one made up. ;)
     

    Attached Files:

    Kenneth Holland likes this.
  5. Kenneth Holland

    Kenneth Holland Active Member

    oh ok. And I assume that if my XF install is in a sub directory then put it at the root of the install?

    Thannks. K
     
  6. Steve F

    Steve F Well-Known Member

    Yes the root for your site, or if you have your forum in say "community" make it like so but keep it in the root directory still.

    Code:
    User-agent *
    Disallow: /community/
     
    
    I added a robots.txt in my previous post.
     
    Kenneth Holland likes this.
  7. Kenneth Holland

    Kenneth Holland Active Member

    Awesome! Thank you. :)
     
  8. Kenneth Holland

    Kenneth Holland Active Member

    Hi qwk,

    Sorry I'm a little paranoid so I want to make sure I'm doing this right:

    My root is 'public_html' and that's where my Wordpress files reside (the root). So put the file in there and and
    then designate the directory like you said? EXAMPLE: /community/

    Wanted to make sure I didn't tell G to stop indexing my blog. :)

    Ken
     
  9. Steve F

    Steve F Well-Known Member

    Yes, your telling the bots not to crawl "/community/". So your blog is fine.

    If you have WP in your root, public_html, make there isn't already a robots.txt in there. If there is just add that disallow line to it .
     
    Kenneth Holland likes this.
  10. Kenneth Holland

    Kenneth Holland Active Member

    Great! Ok thanks for putting up with me....I appreciate it!
     
    Steve F likes this.

Share This Page