1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

XF 1.5 No sitemaps found for this site

Discussion in 'XenForo Questions and Support' started by Welder, Oct 6, 2016.

  1. Welder

    Welder Member

    I logged into my Google Search Console and it's reporting "No sitemaps found for this site".

    I know that xenfor generated this sitemap dynamically, but then why is google not finding it, nor several other people that I have working on my site?

    How to ensure that it is working? Now...

    I have never updated my robots.txt since initial XenForo install. Maybe that is the problem? If so, I have no idea how to change the robotx.txt to make a sitemap work with my site. Little confused in this situation.

    Help is appreciated. Please be specific on what I should do in regards to the sitemap and robotx.txt


    Cheers
     
  2. Brogan

    Brogan XenForo Moderator Staff Member

    I have just downloaded your sitemap, so it does exist.

    You shouldn't need an entry in the robots.txt file but you can add one if Google is having trouble locating it.

    You can see how it's done here: https://xenforo.com/robots.txt
     
  3. Welder

    Welder Member

    Thanks Brogan,

    When I add my sites info to emulate your robots.txt, my browser asks me if I want to download the .xml.gz file, but when I input your robots.txt url in my browser, your sitemap comes right up without having to download anything. Why is that? And is that a potential problem on why google is not seeing my sitemap?
     
  4. Brogan

    Brogan XenForo Moderator Staff Member

    The sitemap here is much larger, so it is broken up into separate files, which are listed in the text file.

    Smaller sitemaps are downloaded automatically.
     
  5. Welder

    Welder Member

    Ah... I see. So, I guess I'm okay then.

    Thanks Brogan. Always a great guy.

    Cheers
     
  6. Diana

    Diana Active Member

    I have a similar problem. When I try to access my sitemap at http://www.mysite.com/forum/sitemap.php I get a request to open a file with an xml.gz extension, yet when I look in cpanel the extension is php. Confusing.

    I don't really understand the purpose of a sitemap. I'm assuming it relates to SEO? Actually, my site, once I launch, will be by invite only so I don't really want search engines crawling my site. Does this mean I should just not add the sitemap to my robot.txt file?
     
  7. Tracy Perry

    Tracy Perry Well-Known Member

    Is there a reason you put your site in a /forum subdirectory? You do realize your URL is going to reflect /forum/forums correct? Better to rename it to community or similar if you can't put it in the root of the site location.
     
    Diana likes this.
  8. Brogan

    Brogan XenForo Moderator Staff Member

    XF uses a PHP file to generate the sitemap.

    Restrict view permissions to guests, disable the sitemap, don't add it to robots.txt.
     
    Diana likes this.
  9. Diana

    Diana Active Member

    I have no problem with it. The URL shows up as mysite.com/forum/index.php
     
  10. Diana

    Diana Active Member

    Thank you Brogan.
     
  11. Tracy Perry

    Tracy Perry Well-Known Member

    then if you are in the root, you don't access your sitemap at yoursite.com/forum/sitemap.php but at yoursite.com/sitemap.php. That's what was throwing me off as your example below shows to be accessing it in a /forum subdirectory.... or did you "assume" since /forum is added to the route of the index.php that it gets added to sitemap.php (which is a fairly common mistake from people that are not familiar with the routes sub-system)?

    This was what I was referring to.

    And when I access the file via my normal route (mysite.com/sitemap.php) I also receive teh GZ file that it offers to download. The search engine recognizes those files as an archive and can extract the contents from them. The sitemap.php is a processing file that generates that GZ extension and sends it to the requestor.
    Some scripts (or add-ons) will generate the text on the site and then send it - XenForo does it differently and sends the (perfectly acceptable) GZ archive that has the standard sitemap contents format in the compressed file.

    Code:
    <?xml version="1.0" encoding="UTF-8"?>
    <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:image="http://www.google.com/schemas/sitemap-image/1.1">
        <url><loc>https://thebent.bike/</loc></url>
        <url><loc>https://thebent.bike/ams/category/diy-projects.2/</loc></url>
        <url><loc>https://thebent.bike/ams/category/reviews.3/</loc></url>
        <url><loc>https://thebent.bike/forums/the-rest-stop.21/</loc></url>
        <url><loc>https://thebent.bike/forums/site-news-feedback.20/</loc></url>
        <url><loc>https://thebent.bike/pages/privacy/</loc></url>
        <url><loc>https://thebent.bike/forums/bike.26/</loc></url>
        <url><loc>https://thebent.bike/forums/trike.27/</loc></url>
        <url><loc>https://thebent.bike/forums/velomobile.33/</loc></url>
        <url><loc>https://thebent.bike/forums/technical-assistance-zone.32/</loc></url>
        <url><loc>https://thebent.bike/forums/ride-reports.34/</loc></url>
        <url><loc>https://thebent.bike/forums/commuting.36/</loc></url>
        <url><loc>https://thebent.bike/forums/touring-zone.35/</loc></url>
        <url><loc>https://thebent.bike/forums/racing-zone.28/</loc></url>
        <url><loc>https://thebent.bike/forums/equipment-talk.29/</loc></url>
        <url><loc>https://thebent.bike/forums/electric-assist-powered.30/</loc></url>
        <url><loc>https://thebent.bike/forums/for-sale-trade.31/</loc></url>
        <url><loc>https://thebent.bike/forums/dfbikes/</loc></url>
        <url><loc>https://thebent.bike/forums/trikes.16/</loc></url>
        <url><loc>https://thebent.bike/downloads/catrike-owners-manual.1/</loc><lastmod>2015-12-02T06:13:11+00:00</lastmod></url>
        <url><loc>https://thebent.bike/downloads/catrike-owners-manual.2/</loc><lastmod>2015-12-03T21:08:12+00:00</lastmod></url>
        <url><loc>https://thebent.bike/tags/rally/</loc><lastmod>2015-11-19T18:59:03+00:00</lastmod></url>
        <url><loc>https://thebent.bike/tags/austin/</loc><lastmod>2016-06-04T15:57:46+00:00</lastmod></url>
        <url><loc>https://thebent.bike/tags/texas/</loc><lastmod>2015-11-19T18:59:03+00:00</lastmod></url>
        <url><loc>https://thebent.bike/tags/559/</loc><lastmod>2015-11-21T02:51:53+00:00</lastmod></url>
        <url><loc>https://thebent.bike/tags/catrike/</loc><lastmod>2015-11-21T02:51:53+00:00</lastmod></url>
        <url><loc>https://thebent.bike/tags/owners-manual/</loc><lastmod>2015-12-03T21:08:12+00:00</lastmod></url>
        <url><loc>https://thebent.bike/tags/easy-street/</loc><lastmod>2016-06-04T15:57:46+00:00</lastmod></url>
        <url><loc>https://thebent.bike/tags/cargo/</loc><lastmod>2016-11-21T03:55:57+00:00</lastmod></url>
        <url><loc>https://thebent.bike/tags/gear/</loc><lastmod>2016-11-21T03:55:57+00:00</lastmod></url>
        
     
  12. Diana

    Diana Active Member

    Um... not sure I understand you. The sitemap is in mysite.com/forum/sitemap.php.


    This was what I was referring to.

    I was wondering why I can see the xenforo sitemap but not mine. Thanks for the explanation.
     
  13. Tracy Perry

    Tracy Perry Well-Known Member

Share This Page