Diana
Active member
As far as I can see, google never crawls anything on my site but the events calender.
this is my robots.txt file.
User-agent: *
Disallow: /test/
Disallow: /forum/find-new/
Disallow: /forum/account/
Disallow: /forum/attachments/
Disallow: /forum/conversations/
Disallow: /forum/events/birthdays/
Disallow: /forum/events/monthly
Disallow: /forum/events/weekly
Disallow: /forum/forums/-/
Disallow: /forum/goto/
Disallow: /forum/posts/
Disallow: /forum/login/
Disallow: /forum/events/
Disallow: /forum/profile/
Disallow: /forum/calendar/
Disallow: /forum/misc/
Disallow: /forum/search/
Disallow: /forum/members/
Disallow: /forum/register/
Disallow: /forum/online/
Disallow: /forum/recent-activity/
Disallow: /forum/lost-password/
Disallow: /forum/admin.php
Disallow: /forum/help/
Allow: /
What am I doing wrong?
Meanwhile Baidu is all over the place and completely ignores events. I guess that makes me popular in China?
this is my robots.txt file.
User-agent: *
Disallow: /test/
Disallow: /forum/find-new/
Disallow: /forum/account/
Disallow: /forum/attachments/
Disallow: /forum/conversations/
Disallow: /forum/events/birthdays/
Disallow: /forum/events/monthly
Disallow: /forum/events/weekly
Disallow: /forum/forums/-/
Disallow: /forum/goto/
Disallow: /forum/posts/
Disallow: /forum/login/
Disallow: /forum/events/
Disallow: /forum/profile/
Disallow: /forum/calendar/
Disallow: /forum/misc/
Disallow: /forum/search/
Disallow: /forum/members/
Disallow: /forum/register/
Disallow: /forum/online/
Disallow: /forum/recent-activity/
Disallow: /forum/lost-password/
Disallow: /forum/admin.php
Disallow: /forum/help/
Allow: /
What am I doing wrong?
Meanwhile Baidu is all over the place and completely ignores events. I guess that makes me popular in China?