Have most forums lost traffic from Google since April 2024?

User-agent: PetalBot
User-agent: AspiegelBot
User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: DotBot
User-agent: MauiBot
User-agent: MJ12bot
Disallow: /

User-agent: Amazonbot
Disallow: /threads/*/reply

User-agent: *
Disallow: /whats-new/
Disallow: /account/
Disallow: /attachments/
Disallow: /goto/
Disallow: /posts/
Disallow: /login/
Disallow: /search/
Disallow: /data/
Disallow: /styles/
Disallow: /misc/
Disallow: /resources/*/download
Disallow: /css.php
Disallow: /admin.php
Allow: /

Sitemap: https://permaforo.net/sitemap.xml
 
User-agent: PetalBot
User-agent: AspiegelBot
User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: DotBot
User-agent: MauiBot
User-agent: MJ12bot
Disallow: /

User-agent: Amazonbot
Disallow: /threads/*/reply

User-agent: *
Disallow: /whats-new/
Disallow: /account/
Disallow: /attachments/
Disallow: /goto/
Disallow: /posts/
Disallow: /login/
Disallow: /search/
Disallow: /data/
Disallow: /styles/
Disallow: /misc/
Disallow: /resources/*/download
Disallow: /css.php
Disallow: /admin.php
Allow: /

Sitemap: https://permaforo.net/sitemap.xml
should I add the same on my robot? what's the benefit?
 
Badly added... as your xenforo instance is located in the /forum folder... correct the path as you done here:
Code:
User-agent: *
Disallow: /forum/members/*

And add a / to this:
Code:
User-agent: grapeshot
Disallow: /
 
just upgrade to XF 2.3.2 & feel the power, your site indexing will go high, website will get better result on google search
I got 1k page indexing everyday after upgrade

you need also check websitelist addon from Ozzy
may be someone spammed your forum
 
just upgrade to XF 2.3.2 & feel the power, your site indexing will go high, website will get better result on google search
but need also check websitelist addon from Ozzy
may be someone spammed your forum
I have upgraded already
 
Back
Top Bottom