Non Guru
Member
Hello..
On your robot.sample.txt
I put my site map, so it looks like this:
User-agent: *
Disallow: /account/
Disallow: /find-new/
Disallow: /help/
Disallow: /goto/
Disallow: /login/
Disallow: /lost-password/
Disallow: /misc/style/
Disallow: /online/
Disallow: /posts/
Disallow: /recent-activity/
Disallow: /register/
Disallow: /search/
Disallow: /admin.php
Disallow: /index.php?account/
Disallow: /index.php?find-new/
Disallow: /index.php?help/
Disallow: /index.php?goto/
Disallow: /index.php?login/
Disallow: /index.php?lost-password/
Disallow: /index.php?misc/style/
Disallow: /index.php?online/
Disallow: /index.php?posts/
Disallow: /index.php?recent-activity/
Disallow: /index.php?register/
Disallow: /index.php?search/
Disallow: /admin.php
Allow: /
Sitemap: http://myforum.com/sitemap/sitemap.xml.gz
Is that correct ?
or should I enter after Allow:/
So it will look like this:
Allow: /Sitemap: http://myforum.com/sitemap/sitemap.xml.gz
I just want to make sure so Search engine bot will crawl my site correctly.
Also I need to upload the robot.txt to my root or to sitemap directory ?
On your robot.sample.txt
I put my site map, so it looks like this:
User-agent: *
Disallow: /account/
Disallow: /find-new/
Disallow: /help/
Disallow: /goto/
Disallow: /login/
Disallow: /lost-password/
Disallow: /misc/style/
Disallow: /online/
Disallow: /posts/
Disallow: /recent-activity/
Disallow: /register/
Disallow: /search/
Disallow: /admin.php
Disallow: /index.php?account/
Disallow: /index.php?find-new/
Disallow: /index.php?help/
Disallow: /index.php?goto/
Disallow: /index.php?login/
Disallow: /index.php?lost-password/
Disallow: /index.php?misc/style/
Disallow: /index.php?online/
Disallow: /index.php?posts/
Disallow: /index.php?recent-activity/
Disallow: /index.php?register/
Disallow: /index.php?search/
Disallow: /admin.php
Allow: /
Sitemap: http://myforum.com/sitemap/sitemap.xml.gz
Is that correct ?
or should I enter after Allow:/
So it will look like this:
Allow: /Sitemap: http://myforum.com/sitemap/sitemap.xml.gz
I just want to make sure so Search engine bot will crawl my site correctly.
Also I need to upload the robot.txt to my root or to sitemap directory ?