Num7
Active member
Hi,
I haven't used the Google Search Console in a while, and I noticed something today. My forum has tons of content that Google won't index. No idea why.
I've re-submitted my sitemap. I've also updated my robot.txt file, here it is. I copied the one here on xenforo.com/community.
I did a couple of spot-checks with content I picked randomly on my site, and a ton of it can't be found on Google. So what the report says about these 39K pages is true. They're not indexed. So most of my site isn't indexed at all. That's not good.
Any help would be appreciated. What should I do?
Thanks!
I haven't used the Google Search Console in a while, and I noticed something today. My forum has tons of content that Google won't index. No idea why.
I've re-submitted my sitemap. I've also updated my robot.txt file, here it is. I copied the one here on xenforo.com/community.
Code:
User-agent: PetalBot
User-agent: AspiegelBot
User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: DotBot
User-agent: MauiBot
User-agent: MJ12bot
Disallow: /
User-agent: Amazonbot
Disallow: /threads/*/reply
User-agent: *
Disallow: /whats-new/
Disallow: /account/
Disallow: /attachments/
Disallow: /goto/
Disallow: /posts/
Disallow: /login/
Disallow: /search/
Disallow: /admin.php
Disallow: /cig-bin/
Allow: /
Sitemap: https://paranormalis.com/sitemap-1.xml
I did a couple of spot-checks with content I picked randomly on my site, and a ton of it can't be found on Google. So what the report says about these 39K pages is true. They're not indexed. So most of my site isn't indexed at all. That's not good.
Any help would be appreciated. What should I do?
Thanks!