• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.

G Webmaster tools seeing thousands of /search/ URLS ?

MRaburn

Active member
#1
I was playing in Google Webmaster tools and found this today.

Somehow on the 29th of Feb Google now has 1000s of URLs to search URLS from Xenforo. This would be about the day I upgraded to the latest version.

I have now blocked it in our robots.txt file but does anyone know how Google is seeing thousands of search queries? They get a 403 because we do not allow 'guests' to use the search.

Thanks for any insight!

Google ChromeScreenSnapz012.jpg
 

digitalpoint

Well-known member
#2
Each member profile gives 2 links that end up at search results (the Information tab has the "Find all content/threads by xxxx").
 

MRaburn

Active member
#3
Thanks! I added a robots.txt entry to prevent G. Im sure there is no penalty with it, just thought best to clean it up a bit from the reports.