Help with duplicate content.

markbrule

Member
Hello community. I may need a little bit of advise. I just opened a xenforo 2.0 forum less than 2 weeks ago and Siteliner is telling me that nearly all my content is duplicated... Should I worry ? If yes, could point in the right direction ?

Thank you!!!


202476
 

djbaxter

Well-known member
That's just reporting alternate URLs for the same content.

You can add a robots.txt file to the root of your forum by adapting the one used here at xenforo.com:

See https://xenforo.com/robots.txt

Assuming your forum is in the root of your domain, it will look like this:

Code:
User-agent: *
Disallow: /whats-new/
Disallow: /account/
Disallow: /attachments/
Disallow: /goto/
Disallow: /posts/
Disallow: /login/
Disallow: /admin.php
Allow: /

Sitemap: https://yourdomain.com/sitemap.xml
If the forum is in a subdirectory called /forum it would look like this:

Code:
User-agent: *
Disallow: /forum/whats-new/
Disallow: /forum/account/
Disallow: /forum/attachments/
Disallow: /forum/goto/
Disallow: /forum/posts/
Disallow: /forum/login/
Disallow: /forum/admin.php
Allow: /

Sitemap: https://yourdomain.com/sitemap.xml
 
Top