XF 2.0 complete page "noindex"

[Tealk]

Hello,

I have the problem that my whole forum is listed under "noindex". I don't know why. Can someone help me?

 

[Paul B]

What do you mean by "listed under "noindex""?

Where?

 

[Tealk]

Hallo @Brogan

on Google Search Console



and in the xenforo templates i have found:
<xf:head option="metaNoindex"><meta name="robots" content="noindex" /></xf:head>


Green are the indexed pages that have decreased all at once.

 

[Mike]

The details tell you why - it's being blocked by the X-Robots-Tag HTTP header. This isn't something that XenForo sets, so you must be setting it at the server level.

(There are several other headers that see are being returned that aren't set by XF and can, theoretically, cause some issues in some scenarios, so be aware if you're globally setting custom headers.)

 

[Tealk]

I never have set a X-Robots-Tag HTTP header, thats my problem.
I have also checked everything, the only time where on the whole webserver "noindex" occurs is here: <xf:head option="metaNoindex"><meta name="robots" content="noindex" /></xf:head>

 

[Mike]

The header isn't coming from XenForo itself. It would likely be set in your web server (or perhaps .htaccess). If you're on shared hosting, you may wish to ask your host about it. If you're on VPS/dedicated and you used a package that preconfigured things for you, you may need to query where they put these sort of settings.

 

[Tealk]

As you can see here "X-Robots Day" is "all".

 

[Tealk]

Where does the metaNoindex option come from?

 

[Mike]

It's defined in the templates as necessary. However, to reiterate, the problem is coming from the X-Robots-Tag: noindex value (as per the GSC screenshot you showed). You can see it here: https://anzahcraft.de/sitemap.php

This is being added outside of XenForo (as are a large number of other headers).