XF 1.5 No sitemaps found for this site

Welder

Member
I logged into my Google Search Console and it's reporting "No sitemaps found for this site".

I know that xenfor generated this sitemap dynamically, but then why is google not finding it, nor several other people that I have working on my site?

How to ensure that it is working? Now...

I have never updated my robots.txt since initial XenForo install. Maybe that is the problem? If so, I have no idea how to change the robotx.txt to make a sitemap work with my site. Little confused in this situation.

Help is appreciated. Please be specific on what I should do in regards to the sitemap and robotx.txt


Cheers
 
Thanks Brogan,

When I add my sites info to emulate your robots.txt, my browser asks me if I want to download the .xml.gz file, but when I input your robots.txt url in my browser, your sitemap comes right up without having to download anything. Why is that? And is that a potential problem on why google is not seeing my sitemap?
 
The sitemap here is much larger, so it is broken up into separate files, which are listed in the text file.

Smaller sitemaps are downloaded automatically.
 
I have a similar problem. When I try to access my sitemap at http://www.mysite.com/forum/sitemap.php I get a request to open a file with an xml.gz extension, yet when I look in cpanel the extension is php. Confusing.

I don't really understand the purpose of a sitemap. I'm assuming it relates to SEO? Actually, my site, once I launch, will be by invite only so I don't really want search engines crawling my site. Does this mean I should just not add the sitemap to my robot.txt file?
 
Is there a reason you put your site in a /forum subdirectory? You do realize your URL is going to reflect /forum/forums correct? Better to rename it to community or similar if you can't put it in the root of the site location.
 
Is there a reason you put your site in a /forum subdirectory? You do realize your URL is going to reflect /forum/forums correct? Better to rename it to community or similar if you can't put it in the root of the site location.

I have no problem with it. The URL shows up as mysite.com/forum/index.php
 
I have no problem with it. The URL shows up as mysite.com/forum/index.php
then if you are in the root, you don't access your sitemap at yoursite.com/forum/sitemap.php but at yoursite.com/sitemap.php. That's what was throwing me off as your example below shows to be accessing it in a /forum subdirectory.... or did you "assume" since /forum is added to the route of the index.php that it gets added to sitemap.php (which is a fairly common mistake from people that are not familiar with the routes sub-system)?

When I try to access my sitemap at http://www.mysite.com/forum/sitemap.php
This was what I was referring to.

And when I access the file via my normal route (mysite.com/sitemap.php) I also receive teh GZ file that it offers to download. The search engine recognizes those files as an archive and can extract the contents from them. The sitemap.php is a processing file that generates that GZ extension and sends it to the requestor.
Some scripts (or add-ons) will generate the text on the site and then send it - XenForo does it differently and sends the (perfectly acceptable) GZ archive that has the standard sitemap contents format in the compressed file.

Code:
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:image="http://www.google.com/schemas/sitemap-image/1.1">
    <url><loc>https://thebent.bike/</loc></url>
    <url><loc>https://thebent.bike/ams/category/diy-projects.2/</loc></url>
    <url><loc>https://thebent.bike/ams/category/reviews.3/</loc></url>
    <url><loc>https://thebent.bike/forums/the-rest-stop.21/</loc></url>
    <url><loc>https://thebent.bike/forums/site-news-feedback.20/</loc></url>
    <url><loc>https://thebent.bike/pages/privacy/</loc></url>
    <url><loc>https://thebent.bike/forums/bike.26/</loc></url>
    <url><loc>https://thebent.bike/forums/trike.27/</loc></url>
    <url><loc>https://thebent.bike/forums/velomobile.33/</loc></url>
    <url><loc>https://thebent.bike/forums/technical-assistance-zone.32/</loc></url>
    <url><loc>https://thebent.bike/forums/ride-reports.34/</loc></url>
    <url><loc>https://thebent.bike/forums/commuting.36/</loc></url>
    <url><loc>https://thebent.bike/forums/touring-zone.35/</loc></url>
    <url><loc>https://thebent.bike/forums/racing-zone.28/</loc></url>
    <url><loc>https://thebent.bike/forums/equipment-talk.29/</loc></url>
    <url><loc>https://thebent.bike/forums/electric-assist-powered.30/</loc></url>
    <url><loc>https://thebent.bike/forums/for-sale-trade.31/</loc></url>
    <url><loc>https://thebent.bike/forums/dfbikes/</loc></url>
    <url><loc>https://thebent.bike/forums/trikes.16/</loc></url>
    <url><loc>https://thebent.bike/downloads/catrike-owners-manual.1/</loc><lastmod>2015-12-02T06:13:11+00:00</lastmod></url>
    <url><loc>https://thebent.bike/downloads/catrike-owners-manual.2/</loc><lastmod>2015-12-03T21:08:12+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/rally/</loc><lastmod>2015-11-19T18:59:03+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/austin/</loc><lastmod>2016-06-04T15:57:46+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/texas/</loc><lastmod>2015-11-19T18:59:03+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/559/</loc><lastmod>2015-11-21T02:51:53+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/catrike/</loc><lastmod>2015-11-21T02:51:53+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/owners-manual/</loc><lastmod>2015-12-03T21:08:12+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/easy-street/</loc><lastmod>2016-06-04T15:57:46+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/cargo/</loc><lastmod>2016-11-21T03:55:57+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/gear/</loc><lastmod>2016-11-21T03:55:57+00:00</lastmod></url>
 
then if you are in the root, you don't access your sitemap at yoursite.com/forum/sitemap.php but at yoursite.com/sitemap.php. That's what was throwing me off as your example below shows to be accessing it in a /forum subdirectory.... or did you "assume" since /forum is added to the route of the index.php that it gets added to sitemap.php (which is a fairly common mistake from people that are not familiar with the routes sub-system)?

Um... not sure I understand you. The sitemap is in mysite.com/forum/sitemap.php.


This was what I was referring to.

And when I access the file via my normal route (mysite.com/sitemap.php) I also receive teh GZ file that it offers to download. The search engine recognizes those files as an archive and can extract the contents from them. The sitemap.php is a processing file that generates that GZ extension and sends it to the requestor.
Some scripts (or add-ons) will generate the text on the site and then send it - XenForo does it differently and sends the (perfectly acceptable) GZ archive that has the standard sitemap contents format in the compressed file.

Code:
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:image="http://www.google.com/schemas/sitemap-image/1.1">
    <url><loc>https://thebent.bike/</loc></url>
    <url><loc>https://thebent.bike/ams/category/diy-projects.2/</loc></url>
    <url><loc>https://thebent.bike/ams/category/reviews.3/</loc></url>
    <url><loc>https://thebent.bike/forums/the-rest-stop.21/</loc></url>
    <url><loc>https://thebent.bike/forums/site-news-feedback.20/</loc></url>
    <url><loc>https://thebent.bike/pages/privacy/</loc></url>
    <url><loc>https://thebent.bike/forums/bike.26/</loc></url>
    <url><loc>https://thebent.bike/forums/trike.27/</loc></url>
    <url><loc>https://thebent.bike/forums/velomobile.33/</loc></url>
    <url><loc>https://thebent.bike/forums/technical-assistance-zone.32/</loc></url>
    <url><loc>https://thebent.bike/forums/ride-reports.34/</loc></url>
    <url><loc>https://thebent.bike/forums/commuting.36/</loc></url>
    <url><loc>https://thebent.bike/forums/touring-zone.35/</loc></url>
    <url><loc>https://thebent.bike/forums/racing-zone.28/</loc></url>
    <url><loc>https://thebent.bike/forums/equipment-talk.29/</loc></url>
    <url><loc>https://thebent.bike/forums/electric-assist-powered.30/</loc></url>
    <url><loc>https://thebent.bike/forums/for-sale-trade.31/</loc></url>
    <url><loc>https://thebent.bike/forums/dfbikes/</loc></url>
    <url><loc>https://thebent.bike/forums/trikes.16/</loc></url>
    <url><loc>https://thebent.bike/downloads/catrike-owners-manual.1/</loc><lastmod>2015-12-02T06:13:11+00:00</lastmod></url>
    <url><loc>https://thebent.bike/downloads/catrike-owners-manual.2/</loc><lastmod>2015-12-03T21:08:12+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/rally/</loc><lastmod>2015-11-19T18:59:03+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/austin/</loc><lastmod>2016-06-04T15:57:46+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/texas/</loc><lastmod>2015-11-19T18:59:03+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/559/</loc><lastmod>2015-11-21T02:51:53+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/catrike/</loc><lastmod>2015-11-21T02:51:53+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/owners-manual/</loc><lastmod>2015-12-03T21:08:12+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/easy-street/</loc><lastmod>2016-06-04T15:57:46+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/cargo/</loc><lastmod>2016-11-21T03:55:57+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/gear/</loc><lastmod>2016-11-21T03:55:57+00:00</lastmod></url>

I was wondering why I can see the xenforo sitemap but not mine. Thanks for the explanation.
 
Top Bottom