1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[error] File does not exist: /public_html/robots.txt

Discussion in 'Server Configuration and Hosting' started by Saburov, Oct 5, 2016.

  1. Saburov

    Saburov Active Member

    My hosting cpanel's error log, there is two error log like this:

    [Wed Oct 05 13:29:15 2016] [error] [client] File does not exist: /home/xxx/public_html/www.muhasebecafe.com/robots.txt

    What does it mean? Should I create a blank robots.txt file in this folder or something else?
  2. Brogan

    Brogan XenForo Moderator Staff Member

    Saburov likes this.
  3. fly

    fly Member

    BTW, if you're wondering what it's for, the file describes certain aspects of your site to search engines. You can use it to tell them not to spider parts of your site, link them to a sitemap, and probably other things that I can't think of right now.
    Saburov likes this.
  4. Saburov

    Saburov Active Member


Share This Page