XF 2.2 Prevent the link suffix from appearing in archives on search engines

[arabia2]

Prevent the link suffix from appearing in archives on search engines

See the picture
How do links appear in the search engine?
I don't want this to appear as a suffix

Is there a solution to this problem

 

[Mr Lucky]

Robots.txt file might stop this. This is the robots.txt used be xenforo and as you can see posts are disallowed

User-agent: PetalBot
User-agent: AspiegelBot
User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: DotBot
User-agent: MauiBot
User-agent: MJ12bot
Disallow: /community/

User-agent: Amazonbot
Disallow: /community/threads/*/reply

User-agent: *
Disallow: /community/whats-new/
Disallow: /community/account/
Disallow: /community/attachments/
Disallow: /community/goto/
Disallow: /community/posts/
Disallow: /community/login/
Disallow: /community/search/
Disallow: /community/admin.php
Allow: /

Sitemap: https://xenforo.com/community/sitemap.xml[

 

[arabia2]

Robots.txt file might stop this. This is the robots.txt used be xenforo and as you can see posts are disallowed

User-agent: PetalBot
User-agent: AspiegelBot
User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: DotBot
User-agent: MauiBot
User-agent: MJ12bot
Disallow: /community/

User-agent: Amazonbot
Disallow: /community/threads/*/reply

User-agent: *
Disallow: /community/whats-new/
Disallow: /community/account/
Disallow: /community/attachments/
Disallow: /community/goto/
Disallow: /community/posts/
Disallow: /community/login/
Disallow: /community/search/
Disallow: /community/admin.php
Allow: /

Sitemap: https://xenforo.com/community/sitemap.xml[

Thank you, my friend. I will work on the modifications you mentioned

 

[arabia2]

Robots.txt file might stop this. This is the robots.txt used be xenforo and as you can see posts are disallowed

User-agent: PetalBot
User-agent: AspiegelBot
User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: DotBot
User-agent: MauiBot
User-agent: MJ12bot
Disallow: /community/

User-agent: Amazonbot
Disallow: /community/threads/*/reply

User-agent: *
Disallow: /community/whats-new/
Disallow: /community/account/
Disallow: /community/attachments/
Disallow: /community/goto/
Disallow: /community/posts/
Disallow: /community/login/
Disallow: /community/search/
Disallow: /community/admin.php
Allow: /

Sitemap: https://xenforo.com/community/sitemap.xml[

I reviewed Roberts' file

I found that I had actually prevented spiders from archiving this paragraph

So where is the problem?

See the picture

 

[Mr Lucky]

So where is the problem?

/vb/ ?

 

[bzcomputers]

Be aware doing this...

Disallow: /community/posts/

will have no effect on urls like...
/threads/168834/#post-518139

you would need to add this line to robots.txt...

Disallow: *#post-*

 

[Chromaniac]

sadly. this would also not completely stop it from happening.

Robots.txt Introduction and Guide | Google Search Central | Documentation | Google for Developers

Robots.txt is used to manage crawler traffic. Explore this robots.txt introduction guide to learn what robot.txt files are and how to use them.

developers.google.com