Active member
I am seeing lots of topics about bots, and this interests me. I would like to possibly block some things from google, and maybe even increase the google crawl frequency as i do not have loads of content on google. Maybe just have google read from my threads, and other forum related things. Anyone have any robots.txt suggestions? all of this is too confusing for me, i would appreciate some help if anyone would be so kind, and possibly help me write one up? Thanks. :)
Top Bottom