XF 1.5 How to disallow crawling complete RM and one Node through robots.txt

[Sunka]

What to add in robots.txt file to disallow Google and other spiders from crawling complete Resources manager and one complete Category (included all in it)?
Thanks

 

[Mike]

If you just want to disallow the entire RM, then you can block /resources/. However, if you are trying to block a single category, you can't do this via robots.txt. You would need to modify the resource_view template:

<xen:if is="{$resource.resource_category_id} == 123">
<xen:container var="$head.noindex"><meta name="robots" content="noindex" /></xen:container>
</xen:if>

(I haven't tested this, so please check the code is being output when you expect.)

 

[Sunka]

If you just want to disallow the entire RM, then you can block /resources/

To add this into robots.txt
Disallow: /resources/

However, if you are trying to block a single category, you can't do this via robots.txt.

I mean category in forum, not category in Resources manager.
Example:
somepage.com/categories/categoryname.23/

 

[Mike]

Ah, the concept is similar but a different template/condition. You'd be checking thread_view and acting based on {$forum.node_id} .

 

[Sunka]

You'd be checking thread_view and acting based on {$forum.node_id} .

If node ID is for example 123
This will be right code:

<xen:if is="{$forum.node_id} == 123">
<xen:container var="$head.noindex"><meta name="robots" content="noindex" /></xen:container>
</xen:if>

Where to put that code in thread_view template?

 

[Mike]

That should be correct. It can go anywhere.

 

[Sunka]

If node ID is for example 123
This will be right code:

<xen:if is="{$forum.node_id} == 123">
<xen:container var="$head.noindex"><meta name="robots" content="noindex" /></xen:container>
</xen:if>

Where to put that code in thread_view template?

That should be correct. It can go anywhere.

@Mike what will be equivalent for xf2?

 

[Sunka]

any help?

 

[Jeremy P]

<xf:if is="{$forum.node_id} == 123">
    <xf:head option="metaNoindex"><meta name="robots" content="noindex" /></xf:head>
</xf:if>

 

[Sunka]

@Jeremy P
on the top of the Thread_view template would be good for that?

 

[Jeremy P]

Yeah, anywhere in the template should be good.