1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Check your robots.txt

Discussion in 'Off Topic' started by Blue, Dec 6, 2012.

  1. Blue

    Blue Well-Known Member

    I happened to look at my robots.txt today and found something added to the end. I did not put it there and do not know how it got there. I edited it out and changed the file permissions to 444.

    #Begin Attracta SEO Tools Sitemap. Do not remove
    sitemap: http://cdn.attracta.com/sitemap/xxxxxxx.xml.gz
    #End Attracta SEO Tools Sitemap. Do not remove
  2. Jason

    Jason Well-Known Member

    Do you use cPanel?
  3. Blue

    Blue Well-Known Member

  4. MattW

    MattW Well-Known Member

  5. Blue

    Blue Well-Known Member

  6. Jason

    Jason Well-Known Member

    It's a standard feature in cPanel now, I believe. The command points web crawlers to the sitemap Attracta creates for you. It'll re-inject it if you mess with those settings again.

Share This Page