Rigel Kentaurus
Well-known member
For that size, you might want to try running it from command line instead with a regular server cron job
There is a Cli.php script provided with the package
XML Sitemap for XenForo 1.3 [Not needed, included in 1.4]
- Thread starter Rigel Kentaurus
- Start date
There is a Cli.php script provided with the package
Rigel Kentaurus
Well-known member
no, not really just a
Code:
php Cli.php
my1es
New member
worked like a charm, thanks again!
rotpar
Active member
Google is telling me that the robots.txt file restricts the access to the sitemap... my robots.txt is empty and even if I write rules to allow the access to it, it doesnt help.
That's my htaccess file:
Do I have to place the robots.txt file in the root folder or in the folder where XF is installed? and do I have to add anything in the robots.txt option in admincp?
That's my htaccess file:
Code:
# Mod_security can interfere with uploading of content such as attachments. If you
# cannot attach files, remove the "#" from the lines below.
#<IfModule mod_security.c>
# SecFilterEngine Off
# SecFilterScanPOST Off
#</IfModule>
ErrorDocument 401 default
ErrorDocument 403 default
ErrorDocument 404 default
ErrorDocument 500 default
<IfModule mod_rewrite.c>
RewriteEngine On
# If you are having problems with the rewrite rules, remove the "#" from the
# line that begins "RewriteBase" below. You will also have to change the path
# of the rewrite to reflect the path to your XenForo installation.
#RewriteBase /xenforo
# This line may be needed to enable WebDAV editing with PHP as a CGI.
#RewriteRule .* - [E=HTTP_AUTHORIZATION:%{HTTP:Authorization}]
RewriteCond %{REQUEST_FILENAME} -f [OR]
RewriteCond %{REQUEST_FILENAME} -l [OR]
RewriteCond %{REQUEST_FILENAME} -d
RewriteRule ^.*$ - [NC,L]
RewriteRule ^(data/|js/|styles/|install/|favicon\.ico|crossdomain\.xml) - [NC,L]
RewriteRule (robots\.txt)$ robots.php [NC,L]
RewriteRule ^.*$ index.php [NC,L]
</IfModule>
ServerSignature Off
RewriteCond %{REQUEST_METHOD} ^(HEAD|TRACE|DELETE|TRACK) [NC,OR]
RewriteCond %{THE_REQUEST} (\\r|\\n|%0A|%0D) [NC,OR]
RewriteCond %{HTTP_REFERER} (<|>|’|%0A|%0D|%27|%3C|%3E|%00) [NC,OR]
RewriteCond %{HTTP_COOKIE} (<|>|’|%0A|%0D|%27|%3C|%3E|%00) [NC,OR]
RewriteCond %{REQUEST_URI} ^/(,|;|:|<|>|”>|”<|/|\\\.\.\\).{0,9999} [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^(java|curl|wget) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (winhttp|HTTrack|clshttp|archiver|loader|email|harvest|extract|grab|miner) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (libwww-perl|curl|wget|python|nikto|scan) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (<|>|’|%0A|%0D|%27|%3C|%3E|%00) [NC,OR]
#Block mySQL injects
RewriteCond %{QUERY_STRING} (;|<|>|’|”|\)|%0A|%0D|%22|%27|%3C|%3E|%00).*(/\*|union|select|insert|cast|set|declare|drop|update|md5|benchmark) [NC,OR]
RewriteCond %{QUERY_STRING} \.\./\.\. [OR]
RewriteCond %{QUERY_STRING} (localhost|loopback|127\.0\.0\.1) [NC,OR]
RewriteCond %{QUERY_STRING} \.[a-z0-9] [NC,OR]
RewriteCond %{QUERY_STRING} (<|>|’|%0A|%0D|%27|%3C|%3E|%00) [NC]
# Note: The final RewriteCond must NOT use the [OR] flag.
# Return 403 Forbidden error.
RewriteRule .* index.php [F]
AuthName "By Invitation Only"
AuthType Basic
AuthUserFile /home/tlx/.htpasswd
<Files "admin.php">
require valid-user
</Files>Do I have to place the robots.txt file in the root folder or in the folder where XF is installed? and do I have to add anything in the robots.txt option in admincp?
Rigel Kentaurus
Well-known member
Needs to be in the root
What is your site URL ?
Regina Ortega
Active member
Hello i moved to another vds, and restore my xenforo database.
But when i try to run the Rebuild sitemap cron. Now it give me a lot of errors. (sitempa folder has 777 permissions)
Server Error
Undefined variable: sitemaps
But when i try to run the Rebuild sitemap cron. Now it give me a lot of errors. (sitempa folder has 777 permissions)
Server Error
Undefined variable: sitemaps
- XenForo_Application::handlePhpError() in XfAddOns/Sitemap/Model/Sitemap.php at line 139
- XfAddOns_Sitemap_Model_Sitemap->runAllAvailableSiteMaps() in XfAddOns/Sitemap/CronEntry/RebuildSitemap.php at line 31
- XfAddOns_Sitemap_CronEntry_RebuildSitemap::run()
- call_user_func() in XenForo/Model/Cron.php at line 356
- XenForo_Model_Cron->runEntry() in XenForo/ControllerAdmin/Cron.php at line 204
- XenForo_ControllerAdmin_Cron->actionRun() in XenForo/FrontController.php at line 310
- XenForo_FrontController->dispatch() in XenForo/FrontController.php at line 132
- XenForo_FrontController->run() in /var/aaa/html/foro.muonline.pe/admin.php at line 13
Rigel Kentaurus
Well-known member
Upgrade to the latest version. This has since been fixed.
IcEWoLF
Well-known member
I am running the latest version and I am also getting the errors:
Code:
#0 /library/XfAddOns/Sitemap/CronEntry/RebuildSitemap.php(31): XfAddOns_Sitemap_Model_Sitemap->runAllAvailableSiteMaps()
#1 [internal function]: XfAddOns_Sitemap_CronEntry_RebuildSitemap::run(Array)
#2 /library/XenForo/Model/Cron.php(356): call_user_func(Array, Array)
#3 /library/XenForo/ControllerAdmin/Cron.php(204): XenForo_Model_Cron->runEntry(Array)
#4 /library/XenForo/FrontController.php(310): XenForo_ControllerAdmin_Cron->actionRun()
#5 /library/XenForo/FrontController.php(132): XenForo_FrontController->dispatch(Object(XenForo_RouteMatch))
#6 /admin.php(13): XenForo_FrontController->run()
#7 {main}Rigel Kentaurus
Well-known member
Is there any other content besides that ? You might have the actual error above that
IcEWoLF
Well-known member
Hi there, here is what is above:
Code:
Exception: Sitemap has been generated - library/XfAddOns/Sitemap/Model/Sitemap.php:159
Generated By: Unknown Account, Today at 5:00 PMI did make sure the directory sitemap was properly CHMOD 777.
Rigel Kentaurus
Well-known member
Oh, that is not an error. Just a log message. See the "Sitemap has been generated"
It logs that daily when the sitemap is generated. You can disable it on the admin control panel
Rigel Kentaurus
Well-known member
You would need to download the sitemapAh okay, I just wanted to make sure of that, because it was appearing in the server error logs.
Also is there a URL that I can view the sitemap without having to download the file?
usAdultAds
Active member
update: never mind, I just saw the notes above.
If everything is ok, then I would suggest that you recode
something so it says in the log, everything is ok or run successful,
maybe in a general log, not in the error log which is for errors...
I found this in my XF server log:
Using Sitemap: 1.2.7b
Exception: Sitemap has been generated - library/XfAddOns/Sitemap/Model/Sitemap.php:159
Generated By: Unknown Account, Saturday at 4:09 AM
Stack Trace
#0 /home/abcoutle/public_html/adulthaven.com/library/XfAddOns/Sitemap/CronEntry/RebuildSitemap.php(31): XfAddOns_Sitemap_Model_Sitemap->runAllAvailableSiteMaps()
#1 /home/abcoutle/public_html/adulthaven.com/library/XenForo/Model/Cron.php(356): XfAddOns_Sitemap_CronEntry_RebuildSitemap::run(Array)
#2 /home/abcoutle/public_html/adulthaven.com/library/XenForo/Cron.php(29): XenForo_Model_Cron->runEntry(Array, Array)
#3 /home/abcoutle/public_html/adulthaven.com/library/XenForo/Cron.php(64): XenForo_Cron->run(Array)
#4 /home/abcoutle/public_html/adulthaven.com/cron.php(12): XenForo_Cron::runAndOutput()
#5 {main}
Request State
array(3) {
["url"] => string(45) "http://www.adulthaven.com
["_GET"] => array(1) {
[1367636964] => string(0) ""
}
["_POST"] => array(0) {
}
}
any ideas?
If everything is ok, then I would suggest that you recode
something so it says in the log, everything is ok or run successful,
maybe in a general log, not in the error log which is for errors...
I found this in my XF server log:
Using Sitemap: 1.2.7b
Exception: Sitemap has been generated - library/XfAddOns/Sitemap/Model/Sitemap.php:159
Generated By: Unknown Account, Saturday at 4:09 AM
Stack Trace
#0 /home/abcoutle/public_html/adulthaven.com/library/XfAddOns/Sitemap/CronEntry/RebuildSitemap.php(31): XfAddOns_Sitemap_Model_Sitemap->runAllAvailableSiteMaps()
#1 /home/abcoutle/public_html/adulthaven.com/library/XenForo/Model/Cron.php(356): XfAddOns_Sitemap_CronEntry_RebuildSitemap::run(Array)
#2 /home/abcoutle/public_html/adulthaven.com/library/XenForo/Cron.php(29): XenForo_Model_Cron->runEntry(Array, Array)
#3 /home/abcoutle/public_html/adulthaven.com/library/XenForo/Cron.php(64): XenForo_Cron->run(Array)
#4 /home/abcoutle/public_html/adulthaven.com/cron.php(12): XenForo_Cron::runAndOutput()
#5 {main}
Request State
array(3) {
["url"] => string(45) "http://www.adulthaven.com
["_GET"] => array(1) {
[1367636964] => string(0) ""
}
["_POST"] => array(0) {
}
}
any ideas?
sweetpotato
Active member
Which sitemap I should add to GWT? Only sitemap.xml.gz or all 6 sitemaps in sitemap folder?
Thanks,
Thanks,
Rigel Kentaurus
Well-known member
Just sitemap.xml.gz
IcEWoLF
Well-known member
Hi Rigel, how do I point: http://www.47r-squad.com/robots.txt to http://www.47r-squad.com/index.php?xfa-robots/index ?
Unfortunately I am not an .htaccess expert
Unfortunately I am not an .htaccess expert
Rigel Kentaurus
Well-known member
There is an .htaccess sample on the zip file, you could try using one of those
If you already have an .htaccess make a backup
