XF 1.4 sitemap major issues
- Thread starter Echelon
- Start date
It's quite simple, really, there's not much that can go wrong.
How are you calculating 800 URLs?
What content types do you have checked to include in the Sitemap in Admin CP > Options > XML Sitemap?
Do you have any forums that are not visible to guests?
How are you calculating 800 URLs?
What content types do you have checked to include in the Sitemap in Admin CP > Options > XML Sitemap?
Do you have any forums that are not visible to guests?
Echelon
Active member
yes. and they are not indexed
extra
does this has something to do with route options because the normal routes are in English and i translated them into Dutch
i.e. see visual below
Echelon
Active member
So what you say is that the sitemap structure is in good order and i miss no important things?
i do not need to fill in extra urls and xenforo sitemap recognise the routechanges i made?
Ok.
This is where the confusion lies.
The idea of a sitemap isn't necessarily to tell a search engine about every single URL on your site down to the finest detail, and providing a sitemap doesn't necessarily say to the search engine that they are your ONLY URLs.
If your sitemap contains 100 URLs and Google indexes 1000; there's no problem.
There's a few factors to consider:
- The Sitemap generation does not include every page of every thread (or every page of every other piece of content), it only includes the URL to the first page.
- The Sitemap won't include content you have hidden from guests using permissions.
- The Sitemap won't include URLs from add-ons unless those add-ons have specifically added support for the Sitemap feature, e.g. you have a lot of "tags" pages indexed in Google, but these won't appear in the Sitemap unless that add-on adds support for that.
- Search engines are typically more than capable of finding their own way around. They will often find URLs you may not have explicitly included in the Sitemap, hence why in the example above it has indexed tags pages even though you don't have a sitemap for them.
- Search engines may index pages blocked using robots.txt, and may crawl pages specified as "noindex" but exclude the content from search results.
Correct. All is good and you do not need to do anything extra.
All that being said, your Sitemap does contain some duplicate URLs and I'm not sure why it would.
Those URLs both go to the same page but the only difference is one is the original route, and one is the route you've changed that original route to with a route filter.
Code:
<url><loc>http://www.socialmediatalk.nl/databank/google-brand-page-audit.1/</loc><lastmod>2013-10-21T13:46:13+00:00</lastmod></url>
<url><loc>http://www.socialmediatalk.nl/resources/google-brand-page-audit.1/</loc><lastmod>2013-10-21T13:46:13+00:00</lastmod></url>Those URLs both go to the same page but the only difference is one is the original route, and one is the route you've changed that original route to with a route filter.
Echelon
Active member
Wow! Thanks a lot Chris for debunking my confusion and uncertainty about this sitemap issue. Now I'm satisfied.
Echelon
Active member
Well...as it seems the first is the translated one from resources [US] to Databank [Dutch]
How to solve this?
I don't know, it's not a behaviour I would expect to see.
It's not a big problem because Google would understand what's going on as one 301 redirects to the other.
If you go to Admin CP > Tools > Rebuild Caches > Rebuild XML Sitemap, it will rebuild the Sitemap for you. Then I'll check again.
I can't reproduce this myself by adding a Route Filter...
It's not a big problem because Google would understand what's going on as one 301 redirects to the other.
If you go to Admin CP > Tools > Rebuild Caches > Rebuild XML Sitemap, it will rebuild the Sitemap for you. Then I'll check again.
I can't reproduce this myself by adding a Route Filter...
Echelon
Active member
Would be nice if this can be solved...i miss the knowledge to solve it myself. Thanks again Chris for sorting things out
Have you added URLs manually to the sitemap? The order seems completely inconsistent as well, which is odd given that the sitemap is built by content type and with increasing IDs.
Any other add-ons enabled? Try disabling them and rebuilding the sitemap. Can you list all of the route filters you have?
Any other add-ons enabled? Try disabling them and rebuilding the sitemap. Can you list all of the route filters you have?
Echelon
Active member
No. I did not added any other url's. Before i used a sitemap addon but deinstalled it.
got 35 routefilters...how do i list them since i cannot select the text
That crossed my mind too, but they have identical lastmod dates so I assumed they were coming from the same sitemap handler.
Screenshot, or, alternatively, if you're comfortable running queries on the database, run this query and copy and paste (or screenshot) the output:
Code:
SELECT * FROM xf_route_filter WHERE enabled = 1
One point you missed from Mike's post is the question about add-ons. Clearly you have a lot of add-ons.
As a temporary measure, please disable all add-ons except XenForo Resource Manager and generate the Sitemap again.
As soon as you have generated the sitemap, you can re-enable all add-ons.
As a temporary measure, please disable all add-ons except XenForo Resource Manager and generate the Sitemap again.
As soon as you have generated the sitemap, you can re-enable all add-ons.
Echelon
Active member
yes....84 addons minus the ones we don't need anymore because it's integrated in xenforo 1.4 ;-)
Ok. i will disable all the addons except resource manager tonight,
then generate a new sitemap,
then activate all the addons again
sorry for the fuzz but im not technical
Echelon
Active member
at this moment i disabled all addons and created a new sitemap....what to do next?
