Why disallow "posts" in robots.txt ?

[xf_phantom]

  {xen:calc "floor({$thread.reply_count} / {$xenOptions.messagesPerPage}) +1"}

 

[Weppa333]

We have a winner

thanks @xf_phantom !

Until Mike comes here and amazes us with a better solution, this works.

 

[Chris D]

Just want to clarify something:

What does a screenshot of the finished result look like?

 

[Weppa333]

Solving this problem ( create a working hard link to last page) is only the first step in a dozen of template changes in all areas of XF, I'll post a screenshot once I remove all my debug links.

 

[Chris D]

I'm just trying to understand... Where is the last page link?

In the page nav?

 

[Hristo Avramov]

  {xen:calc "floor({$thread.reply_count} / {$xenOptions.messagesPerPage}) +1"}

in which template is this and what is the code I should change ?
Also if there is no page 2 and etc will it add only the thread without reference to page 1 ?

 

[Hristo Avramov]

So anyone, what should we do?

 

[nrep]

Solving this problem ( create a working hard link to last page) is only the first step in a dozen of template changes in all areas of XF, I'll post a screenshot once I remove all my debug links.

Any update on this one? I'd be interested in seeing the result ?

 

[DRE]

What's going on here...

Whatever it is seems cool enough to install an addon for.

 

[CTXMedia]

I just checked my robots.txt file and I didn't have the following entry:

Disallow: /posts/

I just added it to see how that will change things.

@AndyB have you noticed any change - positive or negative?

 

[AndyB]

@AndyB have you noticed any change - positive or negative?

I still have the:

Disallow: /posts/

in my robots.txt file.

Google is indexing my forum very well. Right now I have 1.3 million posts and Google shows to index my forum 289,000 times.

 

[MotMann]

  {xen:calc "floor({$thread.reply_count} / {$xenOptions.messagesPerPage}) +1"}

I must change just that in the library/XenForo/ControllerPublic/Post.php? And where i do that?

Or its better to use the robot.txt: "Disallow: /posts/" or "Disallow: /posts" ? And it's no matter to change the url with the route filter to "Beitrag", so "posts" will be accepted from the robots?

Sorry.. my english is not so good to understand all these postings

 

[emmy]

Hello,
I just created robots.txt and added the below for Google to crawl, but i am not sure about the one in BOLD - please any help will be appreciated?

User-agent: *
Disallow: /community/find-new/
Disallow: /community/account/
Disallow: /community/attachments/
Disallow: /community/goto/
Disallow: /community/posts/
Disallow: /community/login/
Disallow: /community/admin.php
Allow: /

 

[Paul B]

http://xenforo.com/community/threads/why-disallow-posts-in-robots-txt.56006/#post-596780

First answer in the thread.

 

[emmy]

http://xenforo.com/community/threads/why-disallow-posts-in-robots-txt.56006/#post-596780

First answer in the thread.

Thanks

 

[emmy]

Hello,
I just created robots.txt and added the below for Google to crawl, but i am not sure about the one in BOLD - please any help will be appreciated?

User-agent: *
Disallow: /community/find-new/
Disallow: /community/account/
Disallow: /community/attachments/
Disallow: /community/goto/
Disallow: /community/posts/
Disallow: /community/login/
Disallow: /community/admin.php
Allow: /

Hello,

I am getting crawl errors message for the below: Do you think it is advisable to allow them?

Disallow: /community/account/
Disallow: /community/attachments/
Disallow: /community/posts/

 

[Chris D]

These are perfectly acceptable.

403 errors are "access denied". Notice that some of them are attachments, some of them are member profiles. It is the error given by default when a user isn't allowed to view something.

Perfectly fine.

 

[emmy]

These are perfectly acceptable.

403 errors are "access denied". Notice that some of them are attachments, some of them are member profiles. It is the error given by default when a user isn't allowed to view something.

Perfectly fine.

Thank you, Just wanted to confirm

 

[Brandon Sheley]

  {xen:calc "floor({$thread.reply_count} / {$xenOptions.messagesPerPage}) +1"}

Where would we change this and what would we need to change?

Thanks