1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

G Webmaster tools seeing thousands of /search/ URLS ?

Discussion in 'XenForo Questions and Support' started by MRaburn, Mar 2, 2012.

  1. MRaburn

    MRaburn Active Member

    I was playing in Google Webmaster tools and found this today.

    Somehow on the 29th of Feb Google now has 1000s of URLs to search URLS from Xenforo. This would be about the day I upgraded to the latest version.

    I have now blocked it in our robots.txt file but does anyone know how Google is seeing thousands of search queries? They get a 403 because we do not allow 'guests' to use the search.

    Thanks for any insight!

    Google ChromeScreenSnapz012.jpg
  2. digitalpoint

    digitalpoint Well-Known Member

    Each member profile gives 2 links that end up at search results (the Information tab has the "Find all content/threads by xxxx").
  3. MRaburn

    MRaburn Active Member

    Thanks! I added a robots.txt entry to prevent G. Im sure there is no penalty with it, just thought best to clean it up a bit from the reports.
  4. Digital Doctor

    Digital Doctor Well-Known Member

  5. MRaburn

    MRaburn Active Member

Share This Page