1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

XF 1.4 SiteMap

Discussion in 'XenForo Questions and Support' started by New Joe, Oct 10, 2014.

  1. New Joe

    New Joe Active Member

    I was just wondering how does the Sitemap work?

    Does it just do everything automatically?
    Nothing to set up?
     
  2. Brogan

    Brogan XenForo Moderator Staff Member

    You need to add any custom URLs as required.
    Also, if you block access to member profiles using robots.txt/permissions, uncheck the Users option.

    Otherwise there's nothing you need to do.
     
  3. New Joe

    New Joe Active Member

    Such as what?

    I'm interested in this, what kind of things do you add in a robots.txt file?
     
  4. Brogan

    Brogan XenForo Moderator Staff Member

    Anything custom other than nodes, threads and users.
    upload_2014-10-10_10-28-51.png


    https://xenforo.com/robots.txt
     
    adwade likes this.
  5. New Joe

    New Joe Active Member

  6. Brogan

    Brogan XenForo Moderator Staff Member

  7. Mouth

    Mouth Well-Known Member

    Couple of questions ...
    1. Does sitemap refer to /robots.txt and not include URL's that have been disallowed within robots.txt?
    2. Is there a method to not have page nodes appear within sitemap, when you're not showing them on your site?

    Thanks.
     
  8. Brogan

    Brogan XenForo Moderator Staff Member

    There is no dynamic link between robots.txt and the sitemap.
    If you block something in robots.txt then you shouldn't add it to the sitemap.

    Can you clarify?
    If there is no view permission then they won't be indexed.
     
  9. Mouth

    Mouth Well-Known Member

    I have a page node, with no HTML, that is a parent node/category. It's permissions are set/ticked for it to be a private node. When I check Analyze Permissions on the node for guests and a member, View Node is No. Yet, the URL is still be included in the sitemap.
     
  10. Brogan

    Brogan XenForo Moderator Staff Member

    Do you have any add-ons installed which may be interfering?

    Private nodes aren't indexed.
     
  11. tommydamic68

    tommydamic68 Well-Known Member

    If I changed my URL to https: - should I also change my sitemap info in my robots.txt?
     
  12. tommydamic68

    tommydamic68 Well-Known Member

    Never mind, I guess you would.

    Screen Shot 2016-11-24 at 8.04.53 AM.png
     

Share This Page