Prevent Google from Indexing Site-How?

[Kenneth Holland]

Hi,

I'm testing my XF site right now and I don't want Google indexing my site until I launch. Is there any simple way I can restrict this without having to mess with the .htaccess?

Thanks!

Ken

 

[Steve F]

robots.txt

Add

User-agent: *
Disallow: /

 

[Kenneth Holland]

robots.txt

Add

User-agent: *
Disallow: /

Qwk,

Is there a separate robots.txt file in XF installation. Haven't found it.

Ken

 

[Steve F]

Just create a txt file naming it robots.txt and upload to your root directory.

Edit: Already had one made up.

 

[Kenneth Holland]

Just create a txt file naming it robots.txt and upload to your root directory.

oh ok. And I assume that if my XF install is in a sub directory then put it at the root of the install?

Thannks. K

 

[Steve F]

Yes the root for your site, or if you have your forum in say "community" make it like so but keep it in the root directory still.

User-agent *
Disallow: /community/

I added a robots.txt in my previous post.

 

[Kenneth Holland]

Yes the root for your site, or if you have your forum in say "community" make it like so but keep it in the root directory still.

User-agent *
Disallow: /community/

I added a robots.txt in my previous post.

Awesome! Thank you.

 

[Kenneth Holland]

Yes the root for your site, or if you have your forum in say "community" make it like so but keep it in the root directory still.

User-agent *
Disallow: /community/

I added a robots.txt in my previous post.

Hi qwk,

Sorry I'm a little paranoid so I want to make sure I'm doing this right:

My root is 'public_html' and that's where my Wordpress files reside (the root). So put the file in there and and
then designate the directory like you said? EXAMPLE: /community/

Wanted to make sure I didn't tell G to stop indexing my blog.

Ken

 

[Steve F]

Yes, your telling the bots not to crawl "/community/". So your blog is fine.

If you have WP in your root, public_html, make there isn't already a robots.txt in there. If there is just add that disallow line to it .

 

[Kenneth Holland]

Yes, your telling the bots not to crawl "/community/". So your blog is fine.

Great! Ok thanks for putting up with me....I appreciate it!