cmeinck
Well-known member
I noticed a jump in my indexation last week. Despite having /goto/ blocked in robots.txt, Google indexed 20K URLs. I looked here at XenForo and the same has happened.
Searching Google with site:xenforo.com inurl:/goto/ reveals over 6K URLs.
You can remove these using directory removal, but your indexation numbers will be incorrect.
Thoughts?
Searching Google with site:xenforo.com inurl:/goto/ reveals over 6K URLs.
You can remove these using directory removal, but your indexation numbers will be incorrect.
Thoughts?