Keep Alive error on Search Console

[El Porcharo]

My Search Console is complaining about /login/keep-alive URL not being indexed...

It is showing "Submitted URL blocked due to other 4xx issue" which means (according to this page) "The server encountered a 4xx error not covered by any other issue type described here. Try debugging your page using the URL Inspection tool."

I'm aware this is not a page that should be indexed, but I can't find a way to tell Search Console "don't bother, just forget it".

So... is there a way to prevent this kind of system URLs from being indexed at all?

 

[TPerry]

What "search console" are you referring to. Google?
If so, simply exclude the /login/Keep-alive URL in your robots.txt as disallowed from indexing..

 

[El Porcharo]

Google?

Yep

simply exclude the /login/Keep-alive URL in your robots.txt as disallowed from indexing

In fact I was thinking about this, but since Google has already found this and other "system URLs", wouldn't this generate any other kind of errors?

I can't figure out how Google could have found this URL though...

 

[TPerry]

Google will as Google does. At least it will honor the robots.txt and I would include a disallow in there. Most likely any already indexed locations will be removed.

 

[Old Nick]

I can't figure out how Google could have found this URL though...

Remove it form GSC, there is a tool for that.

 

[El Porcharo]

t least it will honor the robots.txt and I would include a disallow in there.

Done, let's see if it works...

Remove it form GSC, there is a tool for that.

Yes, there is... but it's a workaround since every URL you report it's being temporarily removed for 6 months only

 

[Old Nick]

Yes, there is... but it's a workaround since every URL you report it's being temporarily removed for 6 months only

Coupled with a noindex (disallow) in the robots.txt file they end up disappearing from search results

 

[TPerry]

Yes, there is... but it's a workaround since every URL you report it's being temporarily removed for 6 months only

But if included in robots.txt as a disallow, they should not be re-indexed to be included. I'd check ALL of the URL's that you don't want indexed and include them.

This is my robots.txt and I've really not had an issue with it

User-agent: PetalBot
User-agent: AspiegelBot
User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: DotBot
User-agent: MauiBot
User-agent: MJ12bot
User-agent: SemRush
Disallow: /

User-agent: Amazonbot
Disallow: /threads/*/reply

User-agent: *
Disallow: /find-new/
Disallow: /account/
Disallow: /attachments/
Disallow: /goto/
Disallow: /posts/
Disallow: /login/
Disallow: /admin.php
Disallow: /lost-password/
Disallow: /misc/contact/
Disallow: /members/
Disallow: /misc/style
Disallow: /whats-new/
Disallow: /search/
Disallow: /misc/language
Disallow: /forums/rss-feeds.25/
Allow: /