markbrule Member May 15, 2019 #1 Hello community. I may need a little bit of advise. I just opened a xenforo 2.0 forum less than 2 weeks ago and Siteliner is telling me that nearly all my content is duplicated... Should I worry ? If yes, could point in the right direction ? Thank you!!!
Hello community. I may need a little bit of advise. I just opened a xenforo 2.0 forum less than 2 weeks ago and Siteliner is telling me that nearly all my content is duplicated... Should I worry ? If yes, could point in the right direction ? Thank you!!!
D djbaxter in memoriam 1947-2022 May 16, 2019 #2 That's just reporting alternate URLs for the same content. You can add a robots.txt file to the root of your forum by adapting the one used here at xenforo.com: See https://xenforo.com/robots.txt Assuming your forum is in the root of your domain, it will look like this: Code: User-agent: * Disallow: /whats-new/ Disallow: /account/ Disallow: /attachments/ Disallow: /goto/ Disallow: /posts/ Disallow: /login/ Disallow: /admin.php Allow: / Sitemap: https://yourdomain.com/sitemap.xml If the forum is in a subdirectory called /forum it would look like this: Code: User-agent: * Disallow: /forum/whats-new/ Disallow: /forum/account/ Disallow: /forum/attachments/ Disallow: /forum/goto/ Disallow: /forum/posts/ Disallow: /forum/login/ Disallow: /forum/admin.php Allow: / Sitemap: https://yourdomain.com/sitemap.xml
That's just reporting alternate URLs for the same content. You can add a robots.txt file to the root of your forum by adapting the one used here at xenforo.com: See https://xenforo.com/robots.txt Assuming your forum is in the root of your domain, it will look like this: Code: User-agent: * Disallow: /whats-new/ Disallow: /account/ Disallow: /attachments/ Disallow: /goto/ Disallow: /posts/ Disallow: /login/ Disallow: /admin.php Allow: / Sitemap: https://yourdomain.com/sitemap.xml If the forum is in a subdirectory called /forum it would look like this: Code: User-agent: * Disallow: /forum/whats-new/ Disallow: /forum/account/ Disallow: /forum/attachments/ Disallow: /forum/goto/ Disallow: /forum/posts/ Disallow: /forum/login/ Disallow: /forum/admin.php Allow: / Sitemap: https://yourdomain.com/sitemap.xml