• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.

XF 1.5 No sitemaps found for this site

#1
I logged into my Google Search Console and it's reporting "No sitemaps found for this site".

I know that xenfor generated this sitemap dynamically, but then why is google not finding it, nor several other people that I have working on my site?

How to ensure that it is working? Now...

I have never updated my robots.txt since initial XenForo install. Maybe that is the problem? If so, I have no idea how to change the robotx.txt to make a sitemap work with my site. Little confused in this situation.

Help is appreciated. Please be specific on what I should do in regards to the sitemap and robotx.txt


Cheers
 
#3
Thanks Brogan,

When I add my sites info to emulate your robots.txt, my browser asks me if I want to download the .xml.gz file, but when I input your robots.txt url in my browser, your sitemap comes right up without having to download anything. Why is that? And is that a potential problem on why google is not seeing my sitemap?
 

Brogan

XenForo moderator
Staff member
#4
The sitemap here is much larger, so it is broken up into separate files, which are listed in the text file.

Smaller sitemaps are downloaded automatically.
 

Diana

Active member
#6
I have a similar problem. When I try to access my sitemap at http://www.mysite.com/forum/sitemap.php I get a request to open a file with an xml.gz extension, yet when I look in cpanel the extension is php. Confusing.

I don't really understand the purpose of a sitemap. I'm assuming it relates to SEO? Actually, my site, once I launch, will be by invite only so I don't really want search engines crawling my site. Does this mean I should just not add the sitemap to my robot.txt file?
 

Tracy Perry

Well-known member
#7
Is there a reason you put your site in a /forum subdirectory? You do realize your URL is going to reflect /forum/forums correct? Better to rename it to community or similar if you can't put it in the root of the site location.
 

Diana

Active member
#9
Is there a reason you put your site in a /forum subdirectory? You do realize your URL is going to reflect /forum/forums correct? Better to rename it to community or similar if you can't put it in the root of the site location.
I have no problem with it. The URL shows up as mysite.com/forum/index.php
 

Tracy Perry

Well-known member
#11
I have no problem with it. The URL shows up as mysite.com/forum/index.php
then if you are in the root, you don't access your sitemap at yoursite.com/forum/sitemap.php but at yoursite.com/sitemap.php. That's what was throwing me off as your example below shows to be accessing it in a /forum subdirectory.... or did you "assume" since /forum is added to the route of the index.php that it gets added to sitemap.php (which is a fairly common mistake from people that are not familiar with the routes sub-system)?

This was what I was referring to.

And when I access the file via my normal route (mysite.com/sitemap.php) I also receive teh GZ file that it offers to download. The search engine recognizes those files as an archive and can extract the contents from them. The sitemap.php is a processing file that generates that GZ extension and sends it to the requestor.
Some scripts (or add-ons) will generate the text on the site and then send it - XenForo does it differently and sends the (perfectly acceptable) GZ archive that has the standard sitemap contents format in the compressed file.

Code:
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:image="http://www.google.com/schemas/sitemap-image/1.1">
    <url><loc>https://thebent.bike/</loc></url>
    <url><loc>https://thebent.bike/ams/category/diy-projects.2/</loc></url>
    <url><loc>https://thebent.bike/ams/category/reviews.3/</loc></url>
    <url><loc>https://thebent.bike/forums/the-rest-stop.21/</loc></url>
    <url><loc>https://thebent.bike/forums/site-news-feedback.20/</loc></url>
    <url><loc>https://thebent.bike/pages/privacy/</loc></url>
    <url><loc>https://thebent.bike/forums/bike.26/</loc></url>
    <url><loc>https://thebent.bike/forums/trike.27/</loc></url>
    <url><loc>https://thebent.bike/forums/velomobile.33/</loc></url>
    <url><loc>https://thebent.bike/forums/technical-assistance-zone.32/</loc></url>
    <url><loc>https://thebent.bike/forums/ride-reports.34/</loc></url>
    <url><loc>https://thebent.bike/forums/commuting.36/</loc></url>
    <url><loc>https://thebent.bike/forums/touring-zone.35/</loc></url>
    <url><loc>https://thebent.bike/forums/racing-zone.28/</loc></url>
    <url><loc>https://thebent.bike/forums/equipment-talk.29/</loc></url>
    <url><loc>https://thebent.bike/forums/electric-assist-powered.30/</loc></url>
    <url><loc>https://thebent.bike/forums/for-sale-trade.31/</loc></url>
    <url><loc>https://thebent.bike/forums/dfbikes/</loc></url>
    <url><loc>https://thebent.bike/forums/trikes.16/</loc></url>
    <url><loc>https://thebent.bike/downloads/catrike-owners-manual.1/</loc><lastmod>2015-12-02T06:13:11+00:00</lastmod></url>
    <url><loc>https://thebent.bike/downloads/catrike-owners-manual.2/</loc><lastmod>2015-12-03T21:08:12+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/rally/</loc><lastmod>2015-11-19T18:59:03+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/austin/</loc><lastmod>2016-06-04T15:57:46+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/texas/</loc><lastmod>2015-11-19T18:59:03+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/559/</loc><lastmod>2015-11-21T02:51:53+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/catrike/</loc><lastmod>2015-11-21T02:51:53+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/owners-manual/</loc><lastmod>2015-12-03T21:08:12+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/easy-street/</loc><lastmod>2016-06-04T15:57:46+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/cargo/</loc><lastmod>2016-11-21T03:55:57+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/gear/</loc><lastmod>2016-11-21T03:55:57+00:00</lastmod></url>
 

Diana

Active member
#12
then if you are in the root, you don't access your sitemap at yoursite.com/forum/sitemap.php but at yoursite.com/sitemap.php. That's what was throwing me off as your example below shows to be accessing it in a /forum subdirectory.... or did you "assume" since /forum is added to the route of the index.php that it gets added to sitemap.php (which is a fairly common mistake from people that are not familiar with the routes sub-system)?
Um... not sure I understand you. The sitemap is in mysite.com/forum/sitemap.php.


This was what I was referring to.

And when I access the file via my normal route (mysite.com/sitemap.php) I also receive teh GZ file that it offers to download. The search engine recognizes those files as an archive and can extract the contents from them. The sitemap.php is a processing file that generates that GZ extension and sends it to the requestor.
Some scripts (or add-ons) will generate the text on the site and then send it - XenForo does it differently and sends the (perfectly acceptable) GZ archive that has the standard sitemap contents format in the compressed file.

Code:
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:image="http://www.google.com/schemas/sitemap-image/1.1">
    <url><loc>https://thebent.bike/</loc></url>
    <url><loc>https://thebent.bike/ams/category/diy-projects.2/</loc></url>
    <url><loc>https://thebent.bike/ams/category/reviews.3/</loc></url>
    <url><loc>https://thebent.bike/forums/the-rest-stop.21/</loc></url>
    <url><loc>https://thebent.bike/forums/site-news-feedback.20/</loc></url>
    <url><loc>https://thebent.bike/pages/privacy/</loc></url>
    <url><loc>https://thebent.bike/forums/bike.26/</loc></url>
    <url><loc>https://thebent.bike/forums/trike.27/</loc></url>
    <url><loc>https://thebent.bike/forums/velomobile.33/</loc></url>
    <url><loc>https://thebent.bike/forums/technical-assistance-zone.32/</loc></url>
    <url><loc>https://thebent.bike/forums/ride-reports.34/</loc></url>
    <url><loc>https://thebent.bike/forums/commuting.36/</loc></url>
    <url><loc>https://thebent.bike/forums/touring-zone.35/</loc></url>
    <url><loc>https://thebent.bike/forums/racing-zone.28/</loc></url>
    <url><loc>https://thebent.bike/forums/equipment-talk.29/</loc></url>
    <url><loc>https://thebent.bike/forums/electric-assist-powered.30/</loc></url>
    <url><loc>https://thebent.bike/forums/for-sale-trade.31/</loc></url>
    <url><loc>https://thebent.bike/forums/dfbikes/</loc></url>
    <url><loc>https://thebent.bike/forums/trikes.16/</loc></url>
    <url><loc>https://thebent.bike/downloads/catrike-owners-manual.1/</loc><lastmod>2015-12-02T06:13:11+00:00</lastmod></url>
    <url><loc>https://thebent.bike/downloads/catrike-owners-manual.2/</loc><lastmod>2015-12-03T21:08:12+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/rally/</loc><lastmod>2015-11-19T18:59:03+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/austin/</loc><lastmod>2016-06-04T15:57:46+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/texas/</loc><lastmod>2015-11-19T18:59:03+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/559/</loc><lastmod>2015-11-21T02:51:53+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/catrike/</loc><lastmod>2015-11-21T02:51:53+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/owners-manual/</loc><lastmod>2015-12-03T21:08:12+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/easy-street/</loc><lastmod>2016-06-04T15:57:46+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/cargo/</loc><lastmod>2016-11-21T03:55:57+00:00</lastmod></url>
    <url><loc>https://thebent.bike/tags/gear/</loc><lastmod>2016-11-21T03:55:57+00:00</lastmod></url>
I was wondering why I can see the xenforo sitemap but not mine. Thanks for the explanation.