1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

High number of 404's discovered?

Discussion in 'XenForo Questions and Support' started by cmeinck, Feb 27, 2013.

  1. cmeinck

    cmeinck Well-Known Member

    I moved servers in December. A few weeks back I noticed a significant jump in crawl errors (404's) that occurred in December. I checked my .htaccess and from what I can tell, it's all good. I don't know if they were all old broken links that Google is finding years later or what -- I'm also thinking that perhaps I messed up something with my .htaccess during the move. I'm working through the list and setting up 301's, but would love to find the root of the problem. 90k crawl errors is not a good thing.

    BTW, my sitemaps are not showing any errors. Health > Crawl Errors > Not Found shows over 93,000 errors.

    For example (add http://www.)

    is now this thread:

  2. melbo

    melbo Well-Known Member

  3. cmeinck

    cmeinck Well-Known Member

    Correct. That's a sample of the 90K of 404's. I've been setting up manual 301's, but that's an impossible task. Figuring that maybe someone might have suggestions on what might be missing or not working properly in my htaccess.
  4. cmeinck

    cmeinck Well-Known Member

    BTW, can you please remove that link. I don't want another 404 coming from XF. (y)
  5. melbo

    melbo Well-Known Member

    removed. This sounds like a job for the redirect master: Jake Bunce
  6. craigiri

    craigiri Well-Known Member

    Did you look carefully at the report? I had this problem and it was goog trying to follow links to people's conversations and similar stuff......which I then fixed by disallowing those in robots.txt
  7. cmeinck

    cmeinck Well-Known Member

    The bulk of these are older vBSEO/vBulletin links, which appear to have failed at redirecting.

    I've spent quite a bit of time in Webmasters, trying to clean things up.
  8. cmeinck

    cmeinck Well-Known Member

    Retraced my steps and I seemed to have corrected the bulk of my issues. I configured the 301redirect file from Kier, uploaded the scripts and use the vBSEO redirect tool and placed it close to the top of my htaccess.

    I'm noticing a few oddball URL's that won't redirect. Wherever there is a URL with post in it, so directing to a specific post within a thread, it seems to 404. So for example, this is a busted URL

    I removed http://www to avoid having a 404 from XF.


    Now if I were to change that URL to:

    The current suite of redirects works -- while not to the specific post in the thread, but at least it's not a 404.

    Thoughts, suggestions?

Share This Page