1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

XF 1.4 Site map

Discussion in 'XenForo Questions and Support' started by bsdinsight, Nov 14, 2014.

  1. bsdinsight

    bsdinsight Active Member

    Hi All

    I am not sure how long Xenforo Site Map submit to Google, but I can see my site from Sep 15, 2014 - can you help me to fix it?


    forum.jpg
     
  2. Martok

    Martok Well-Known Member

    You have something in your robots.txt file that disallows Google from crawling, yet you apparently are submitting links in sitemap to crawl that they aren't allowed to due to this.

    I've checked your robots.txt file and can't see anything obvious but you've not given full details of the URLs that are blocked - we can only see part of them.
     
  3. bsdinsight

    bsdinsight Active Member

    Thanks for your information.

    My robots.txt file is:

    User-agent: Mediapartners-Google
    Disallow:

    what information do you need more, please tell me and I can upload for you to help me to fix it.
     
  4. Martok

    Martok Well-Known Member

    The screenshot you posted gives examples of the links that are blocked. However we can't see the full links, only the first part. So, what is blocked?
     
  5. bsdinsight

    bsdinsight Active Member

  6. Martok

    Martok Well-Known Member

    Is it reporting that member profiles are blocked then? Are there other URLs besides these that it reports as blocked? I ask because in your screenshot it shows 3144 problems, yet you only have 1580 members.

    Have you edited the robots.text file recently? Is Google still reporting these URLs as blocked, or only back in September?
     
  7. bsdinsight

    bsdinsight Active Member

    Is it reporting that member profiles are blocked then? Yes
    Are there other URLs besides these that it reports as blocked? No, I can see only 3 links.

    Have you edited the robots.text file recently? No
    Is Google still reporting these URLs as blocked, or only back in September? Only in Sep

    Do you want to logon into my Google account? I can give you.
     
  8. Martok

    Martok Well-Known Member

    If it's not continuing to report these as blocked then I wouldn't worry about it. Just keep an eye on it to see if it happens again.
     
  9. bsdinsight

    bsdinsight Active Member

    it means there are no issues - is it correct?
     
  10. Martok

    Martok Well-Known Member

    I wouldn't worry about it if it's not currently reporting these as blocked but keep an eye on it over the next few weeks.
     
  11. Mike

    Mike XenForo Developer Staff Member

    I would note that this is not related to when Google last read the sitemap; that will be listed elsewhere. It's related to specific errors it found on the sitemap at some point in time. It's possible those errors have since been rectified, but it certainly seems to show them for historical purposes.
     

Share This Page