XML Sitemap for XenForo 1.3 [Not needed, included in 1.4]

[audiokid]

For what its worth, I've uninstalled this because its worse having something broken. After uninstalling it, my site is indexing well anyway. I do appreciate it, but its not ready imho.

 

[Rigel Kentaurus]

Mone says "cron entry was run successfully" but I never see info such as shown above (generating forums, generating index thread, etc.). Likewise, no entries in my server error log. Am I doing something wrong?

It's in http://yoursite/sitemap/sitemap.log, and only if debug is on in the settings
Real test is open your sitemap/ folder through FTP and validate that it was indeed generated

 

[Blackbeard]

Any chance of someone posting their nginx rules rewrites here?

 

[Mouth]

Any chance of someone posting their nginx rules rewrites here?

For ?

 

[Pierre Boulanger]

A noob question. Where i can find the site map of my site that has been created after installing this great add on?
I have some threads that required login:
http://my2cv.gr/forum/forums/historic-citroen-photos-video-brochures.92/
Are these going to be discoverable in search engines after installing this add on?

Many thanks

 

[Rigel Kentaurus]

Here:
http://my2cv.gr/forum/sitemap/sitemap.xml.gz

If the forum is not viewable by the Guest by default the threads shouldn't be there. But do verify.

 

[Blackbeard]

For ?

I thought we needed it as htaccess rewrites are listed.

 

[Rigel Kentaurus]

I thought we needed it as htaccess rewrites are listed.

Only if you want to use it for the robots.php functionality
Everything else works out of the box

 

[Pierre Boulanger]

Here:
http://my2cv.gr/forum/sitemap/sitemap.xml.gz

If the forum is not viewable by the Guest by default the threads shouldn't be there. But do verify.

I'm getting this:

<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <sitemap>
    <loc>http://my2cv.gr/forum/sitemap/sitemap.forums.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://my2cv.gr/forum/sitemap/sitemap.threads.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://my2cv.gr/forum/sitemap/sitemap.members.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://my2cv.gr/forum/sitemap/sitemap.forums.pags.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://my2cv.gr/forum/sitemap/sitemap.threads.pags.1.xml.gz</loc>
  </sitemap>
</sitemapindex>

Is that what it should be?

 

[DistortedDorian]

It seems this addon doesn't create a robots.txt file nor configure a existing one, this is my htaccess.txt file:

ErrorDocument 401 default
ErrorDocument 403 default
ErrorDocument 404 default
ErrorDocument 500 default

<IfModule mod_rewrite.c>
    RewriteEngine On

    RewriteCond %{REQUEST_FILENAME} -f [OR]
    RewriteCond %{REQUEST_FILENAME} -l [OR]
    RewriteCond %{REQUEST_FILENAME} -d
    RewriteRule ^.*$ - [NC,L]
    RewriteRule ^(data/|js/|styles/|install/|favicon\.ico|crossdomain\.xml) - [NC,L]
    RewriteRule (robots\.txt)$ robots.php [NC,L]
    RewriteRule ^.*$ index.php [NC,L]
</IfModule>

I have friendly urls enabled and I can't view /robots.txt after I installed this addon, why?

 

[imspot]

I don't understand something here:
I have a few categories on my forum added to robots.txt because i don't want that google index them, but i still see them on google search results
What is wrong here?

 

[bhanupratap]

@Rigel Kentaurus

I have just installed my forum but m noT ABLE TO INSTALL YOUR SITEMAP

Read me file says :
. Upload all the files in the "upload" folder to your XenForo installation

as i have already mentioned above that i have already installed xenforo , should i upload these file @ public_html ?

 

[Rigel Kentaurus]

@Rigel Kentaurus

I have just installed my forum but m noT ABLE TO INSTALL YOUR SITEMAP

Read me file says :
. Upload all the files in the "upload" folder to your XenForo installation

as i have already mentioned above that i have already installed xenforo , should i upload these file @ public_html ?

Assumming you left XenForo at the root, yes. Upload them inside public_html

 

[farmglitch]

When I use the Google webmaster tools to find the sitemap it cannot. Any suggestions.

 

[Rigel Kentaurus]

When I use the Google webmaster tools to find the sitemap it cannot. Any suggestions.

Did you add it? You need to manually go to the appropiate section and submit it

 

[Gazhyde]

We recently moved the forums from /forum to / but the sitemaps are creating as if it's still in the /forum folder. The sitemap files are being created in /sitemap though

I've removed and reinstalled the add on completely, but it's still including /forum which doesn't exist anymore.

<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.forums.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.pages.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.threads.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.members.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.forums.pags.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.threads.pags.1.xml.gz</loc>
  </sitemap>
</sitemapindex>

  <url>
    <loc>http://zroadster.org/forum/forums/new-to-zroadster-org.11/</loc>
    <lastmod>2014-04-24</lastmod>
  </url>
  <url>
    <loc>http://zroadster.org/forum/forums/the-beauty-parlour.13/</loc>
    <lastmod>2014-04-23</lastmod>
  </url>

 <url>
    <loc>http://zroadster.org/forum/threads/new-smilie-packs-added.11/</loc>
    <lastmod>2011-12-05</lastmod>
  </url>
  <url>
    <loc>http://zroadster.org/forum/threads/found-you.12/</loc>
    <lastmod>2011-12-05</lastmod>
  </url>
  <url>
    <loc>http://zroadster.org/forum/threads/oops.13/</loc>
    <lastmod>2011-12-05</lastmod>
  </url>

 

[ChristianA]

Uhoh ;-)
I've got the problem with a xf forum (1.2.4) that has 1 Million Posts. When sitemap creation is started, it runs some Minutes and then dies away with that:
Allowed memory size of 134217728 bytes exhausted (tried to allocate 78 bytes)...

Do we really need > 128 Megs just for creating a sitemap?

Can I run it via real cronjob / SSH?

Thanks a lot!

 

[Rigel Kentaurus]

Uhoh ;-)
I've got the problem with a xf forum (1.2.4) that has 1 Million Posts. When sitemap creation is started, it runs some Minutes and then dies away with that:
Allowed memory size of 134217728 bytes exhausted (tried to allocate 78 bytes)...

Do we really need > 128 Megs just for creating a sitemap?

Can I run it via real cronjob / SSH?

Thanks a lot!

Yes, there is a CLI utility

 

[Rigel Kentaurus]

We recently moved the forums from /forum to / but the sitemaps are creating as if it's still in the /forum folder. The sitemap files are being created in /sitemap though

I've removed and reinstalled the add on completely, but it's still including /forum which doesn't exist anymore.

<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.forums.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.pages.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.threads.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.members.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.forums.pags.1.xml.gz</loc>
  </sitemap>
  <sitemap>
    <loc>http://zroadster.org/forum/sitemap/sitemap.threads.pags.1.xml.gz</loc>
  </sitemap>
</sitemapindex>

  <url>
    <loc>http://zroadster.org/forum/forums/new-to-zroadster-org.11/</loc>
    <lastmod>2014-04-24</lastmod>
  </url>
  <url>
    <loc>http://zroadster.org/forum/forums/the-beauty-parlour.13/</loc>
    <lastmod>2014-04-23</lastmod>
  </url>

 <url>
    <loc>http://zroadster.org/forum/threads/new-smilie-packs-added.11/</loc>
    <lastmod>2011-12-05</lastmod>
  </url>
  <url>
    <loc>http://zroadster.org/forum/threads/found-you.12/</loc>
    <lastmod>2011-12-05</lastmod>
  </url>
  <url>
    <loc>http://zroadster.org/forum/threads/oops.13/</loc>
    <lastmod>2011-12-05</lastmod>
  </url>

Did you update the site URL in the XenForo options?
It uses that one

 

[ChristianA]

Yes, there is a CLI utility

Thank you!
Ah I just figured it out - that's much better, as the CLI triggered (real cronjob based) version doesn't fall under the 128 mb limit in our server wide php configuration.

Btw: The Sitemap Script itself does a great job. Well done!