Google Stop Indexing My Site (Help Needed)

M

Mbonu

Member
I discovered that Google has stopped indexing my site, all pages and posts are about 2000+ pages, threads and posts not index

Even this sitemap is not google can not find and index it.

Am having the following error when I check on Google Console

No: 'noindex' detected in 'X-Robots-Tag' HTTP header
Page cannot be indexed: Excluded by ‘noindex’ tag

Please see some attachments below and please help me get my site to start being indexed on Google, this is killing my business and not so cool. Help needed, please

See Attachement screenshort

index not working 454.webp

index not working.webp

Site-not-index-3.webp
 
Sort by date Sort by votes
Slavik said:
There seems to be a general "issue" with Google and sitemaps (for any site) currently.
Click to expand...
I discover our have not been indexed since June, also see my friend also using Xenforo site have also stop getting index and not ranking anymore


Just hope the issues is not with Xenforo

If anyone know how I can resolve the No: 'noindex' detected in 'X-Robots-Tag' http header Please help guild me for best solution to this

index not working.webp
 
Upvote 0 Downvote
Slavik said:
There seems to be a general "issue" with Google and sitemaps (for any site) currently.
Click to expand...
I struggled with mine for about 7 months of Google not reading it. Switched it back to Sitemap.php from .xml and everything is working perfectly again. I know it shouldn't matter, but it fixed mine.
 
Upvote 0 Downvote
Did you check if Google is correct and there is 'noindex' detected in 'X-Robots-Tag' http header?

So look at the source-code of any of the not indexded pages / threads and check if there's something like that in it:

HTML: 
    <meta name="robots" content="noindex" />

If so the question is: Where does it come from? The easiest would be the checkbox that you can set per forum node regarding wether indexing would be allowed or not. "Advanced options" under the/each forum node:

Bildschirm­foto 2024-11-21 um 17.14.02.webp

Another option would be that at some point you played around with robots.txt and kind of misconfigured it, so that wider parts of your forum are now set to noindex as a conseqence.
 
Upvote 0 Downvote
Mbonu said:
Even this sitemap is not google can not find and index it.
Click to expand...
The issue with Google Search Console not finding the sitemap has been a topic for ages. Did you search the forum for it? A lot of people suffer from it, nobody knows the root cause, XenForo say: "not our problem" and "will do no harm anyway".

While I disagree with the first statement I can at least confirm that the second one is possibly true. My sitemap is marked as not recognized by GSC since ages and that did not change no matter what I tried:

Bildschirm­foto 2024-11-21 um 17.18.50.webp

Doesn't stop google from indexing my forum.
 
Upvote 0 Downvote
smallwheels said:
Did you check if Google is correct and there is 'noindex' detected in 'X-Robots-Tag' http header?

So look at the source-code of any of the not indexded pages / threads and check if there's something like that in it:

HTML: 
    <meta name="robots" content="noindex" />

If so the question is: Where does it come from? The easiest would be the checkbox that you can set per forum node regarding wether indexing would be allowed or not. "Advanced options" under the/each forum node:

View attachment 314287

Another option would be that at some point you played around with robots.txt and kind of misconfigured it, so that wider parts of your forum are now set to noindex as a conseqence.
Click to expand...
Please do you know where I Can locate the robots.txt file on my xenforo

Possible I will love to change it from noindex to index if that will work
 
Upvote 0 Downvote
Mbonu said:
Please do you know where I Can locate the robots.txt file on my xenforo
Click to expand...
That depends from your environment. Typically it resides in your webroot. You can simply check it's contents with your browser. i.e. here the robots.txt can be found under https://xenforo.com/robots.txt

How this translates to the real filesystem and path of your server is a question only you yourself can answer.
 
Upvote 0 Downvote
Last edited:
Upvote 0 Downvote
Mbonu said:
I just check and mine is having 404 error

This is my URL: https://africachoice.com/robots.txt
Click to expand...
In this case you don't have a robots.txt which means it cannot be responsible for not being indexed. But on the other hand it may help with getting indexed (by google and others) as part of the robots.txt is typically a link to where to find the sitemap.

Klicking on a couple of threads at random and looking in the source code if there is a noindex metatag did not show such a tag. So it would be good if you could post one of the URLs Google is complaining about to see if it is there or not.
 
Upvote 0 Downvote
The sitemap itself isn't supposed to be indexed (meaning it isn't supposed to display in search results). The original post shows the sitemap is being fetched just fine. If your content pages aren't being indexed, it's going to be for a different reason. You can try putting those into the inspector instead to see if there's a reason why.
 
Upvote 0 Downvote
MentaL said:
Wouldn't X-Robots-Tag be at the webserver level since its a header request? You need to adjust your webserver config to remove it.
Click to expand...
As said before Set one of your forum nodes to "noindex" via the advanced node options in ACP and then have a look at the source code of a thread in that forum. you'll find a "nodindex" tag in the metatags of the site header. And that tag is what google claims would be there.
There may be other ways how they can be generated but this is the easiest way.
 
Upvote 0 Downvote
smallwheels said:
As said before Set one of your forum nodes to "noindex" via the advanced node options in ACP and then have a look at the source code of a thread in that forum. you'll find a "nodindex" tag in the metatags of the site header. And that tag is what google claims would be there.
There may be other ways how they can be generated but this is the easiest way.
Click to expand...
Ok i will give that a try. Thanka lot
 
Upvote 0 Downvote
Mean why below

Africa Choice

Join The Africa Choice Digital Marketing Forum & Marketplace, Start Digital Marketing, Forum Discussion, Get the latest News, Technology, Internet Marketing, SEO, Politics, Education, Health, Jobs, And List Your Product | Service. Live on AfricaChoice.com
africachoice.com africachoice.com

Is my site that is not been index

I have tried to rebuild the sitemap , hopeful it will work

But if anyone can help me run a check to see why is not been index by google, I will be glad

Over 2000+ pages, post thread not being indexed.
 
Upvote 0 Downvote
Mbonu said:
Mean why below

Africa Choice

Join The Africa Choice Digital Marketing Forum & Marketplace, Start Digital Marketing, Forum Discussion, Get the latest News, Technology, Internet Marketing, SEO, Politics, Education, Health, Jobs, And List Your Product | Service. Live on AfricaChoice.com
africachoice.com africachoice.com

Is my site that is not been index

I have tried to rebuild the sitemap , hopeful it will work

But if anyone can help me run a check to see why is not been index by google, I will be glad

Over 2000+ pages, post thread not being indexed.
Click to expand...
1732225208952.webpits indexed. Stopping? Hmm. That one is interesting.

UPDATE:

1732225476404.webp

headers seem fine.
 
Upvote 0 Downvote
You must log in or register to reply here.

Similar threads

Yenxji
  • Question Question
Google indexing cannot recognize my site (resource) title
Replies
5
Views
104
Mbonu
M
El Porcharo
  • Question Question
Google Indexing
Replies
14
Views
1K
MySiteGuy
MySiteGuy
raytrails
  • Question Question
XF 2.1 Stop Google from indexing my site
Replies
3
Views
660
JohnDer
JohnDer
vikash
  • Question Question
Suggestions Needed on Installing xenforo on My Site
Replies
2
Views
1K
rv65
R
Kenneth Holland
  • Question Question
Widget Framework Breaks my Site - Help
2
Replies
20
Views
1K
xfrocks
xfrocks
Back
Top Bottom