XF 1.4 Robots and SEO Urls

squashlover

New member
Hi There,

I have recently migrated a forum from VB and all appears to be going good guns aside from a few minor niggles.

We have the VB url redirect in place so that the OLD vb urls will get directed to the correct content. However, I've been asked to block bots from viewing member profiles and a few other things. I can find info that suggests this format for the robots.txt file:

Code:
Disallow: /account/
Disallow: /admin.php
Disallow: /ajax/
Disallow: /attachments/
Disallow: /conversations/
Disallow: /data/
Disallow: /forums/-/
Disallow: /forums/tweets/
Disallow: /goto/
Disallow: /help/
Disallow: /internal_data/
Disallow: /js/
Disallow: /library/
Disallow: /login/
Disallow: /lost-password/
Disallow: /misc/contact/
Disallow: /members/
Disallow: /online/
Disallow: /recent-activity/
Disallow: /register/
Disallow: /posts/
Disallow: /search/
Disallow: /styles/
Allow: /

However, I assume this is for sites that use SEO urls as the format of my urls is /index.php?members/ etc?

Are the SEO htaccess rules available? Can it be used in conjunction with the VB4 redirect?

Thank you!
 
Top Bottom