G Webmaster tools seeing thousands of /search/ URLS ?


Active member
I was playing in Google Webmaster tools and found this today.

Somehow on the 29th of Feb Google now has 1000s of URLs to search URLS from Xenforo. This would be about the day I upgraded to the latest version.

I have now blocked it in our robots.txt file but does anyone know how Google is seeing thousands of search queries? They get a 403 because we do not allow 'guests' to use the search.

Thanks for any insight!

Google ChromeScreenSnapz012.jpg


Well-known member
Each member profile gives 2 links that end up at search results (the Information tab has the "Find all content/threads by xxxx").


Active member
Thanks! I added a robots.txt entry to prevent G. Im sure there is no penalty with it, just thought best to clean it up a bit from the reports.