XF 1.5 Sitemap filtering

[Arno Nühm]

Is it possible to remove those threads from the generated sitemap that are in forums that are not accessible for guests/bots?

I have a lot of 403 crawler errors in the google search console.

 

[Chris D]

Only content which is visible to guests is inserted into the sitemap.

 

[Arno Nühm]

Oh, great, thanks for your fast reply.

So I guess Google is browsing the other URLs somehow... :-/

 

[Chris D]

They'll browse whatever they can find, especially if those forums were not always private, or there are visible links to those forums somewhere.

Worth noting that these sorts of errors are not necessarily going to cause you problems. Google surfaces them so if, for example, every single link on your site is now returning a 403 for a guest because of a mistake with permissions or a bug somewhere then you will be aware and hopefully fix it. If it comes up with anything like this and there's a logical reason for the link being a 403 or some other error then it is safe to ignore.

Google really doesn't care all that much about such things. Certainly not as much as people would have you believe. It just ultimately means those particular links which are giving errors will eventually be removed from their index (which, in this case, they should be).