G Webmaster tools seeing thousands of /search/ URLS ?

[MRaburn]

I was playing in Google Webmaster tools and found this today.

Somehow on the 29th of Feb Google now has 1000s of URLs to search URLS from Xenforo. This would be about the day I upgraded to the latest version.

I have now blocked it in our robots.txt file but does anyone know how Google is seeing thousands of search queries? They get a 403 because we do not allow 'guests' to use the search.

Thanks for any insight!

 

[digitalpoint]

Each member profile gives 2 links that end up at search results (the Information tab has the "Find all content/threads by xxxx").

 

[MRaburn]

Thanks! I added a robots.txt entry to prevent G. Im sure there is no penalty with it, just thought best to clean it up a bit from the reports.

 

[Digital Doctor]

http://xenforo.com/community/threads/robots-txt.16735/

You can't respond as the forum is locked.

 

[MRaburn]

http://xenforo.com/community/threads/robots-txt.16735/

You can't respond as the forum is locked.

Thanks, I took a look at that and tweaked our file.