1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

bots...

Discussion in 'XenForo Questions and Support' started by Sway, Oct 18, 2012.

  1. Sway

    Sway Active Member

    I am seeing lots of topics about bots, and this interests me. I would like to possibly block some things from google, and maybe even increase the google crawl frequency as i do not have loads of content on google. Maybe just have google read from my threads, and other forum related things. Anyone have any robots.txt suggestions? all of this is too confusing for me, i would appreciate some help if anyone would be so kind, and possibly help me write one up? Thanks. :)
     
  2. Chris D

    Chris D XenForo Developer Staff Member

    Jake Bunce likes this.
  3. Sway

    Sway Active Member

    Thanks Chris, i didn't even think of that haha.
     
    Chris D likes this.
  4. Chris D

    Chris D XenForo Developer Staff Member

    Neither did I until I saw Jake Bunce suggest it ;)
     

Share This Page