XF 2.3 Robot.txt 404

[Seeker-Smith]

I just reactivated my Google search and they report my robot.txt is not found. This is the time time I've submitted since 2010.

robots.txt files​

Checked onStatusSize

File
Issues
https://sneaker-groups.com/robots.txt	10/13/24, 7:38 AM	error_outlineNot Fetched - Not found (404)

 

[Paul B]

I just reactivated my Google search and they report my robot.txt is not found.

That's because it doesn't exist.

https://sneaker-groups.com/robots.txt

 

[Seeker-Smith]

Okay, what does Xenforo use to control robots?

 

[Paul B]

https://xenforo.com/robots.txt

 

[Seeker-Smith]

Thanks for the cryptic info. So I;m assuming I must create it.

Thanks

 

[Paul B]

Cryptic?

I provided the correct answer to both of your questions.

What more were you expecting?

 

[Deleted member 184953]

Replace /community/ by /forums/ in your sitemap.

 

[Seeker-Smith]

But were your replies intended to help a paying customer, or to be an ass.

 

[Seeker-Smith]

Replace /community/ by /forums/ in your sitemap.

Can you explain? Where is this done?

 

[Mr Lucky]

Replace /community/ by /forums/ in your sitemap.

That is incorrect

You need to remove /community as your forum is in the root, not a community sub directory as it is here on xenForo

User-agent: *
Disallow: /whats-new/
Disallow: /account/
Disallow: /attachments/
Disallow: /goto/
Disallow  /posts/
Disallow: /login/
Disallow: /search/
Disallow: /admin.php

 

[Deleted member 184953]

Yeah. Just remove /community/ i thought you use /forums/ as subdirectory : https://sneaker-groups.com/forums/

 

[Mr Lucky]

Yeah. Just remove /community/ i thought you use /forums/ as subdirectory : https://sneaker-groups.com/forums/

That one'll get you every time . If /forums/ was a subdirectory we'd have https://sneaker-groups.com/forums/forums/