I'd like to offer an in depth look at the upcoming public launch of SEO & Index tools, an extremely powerful addon which has been in development for over a year.
One important disclaimer:
This article is intentionally verbose, giving very detailed explanations now to gather feedback before information is "compressed" later for convenience. If this is too much for you to read, feel free to skip around!
Further, I have deep understanding of technical/on-page SEO, from everything down to the nitty gritty of "alt" attributes to how link "title" tags pass Page Rank (PR) onto URLs.
With this background, SEO & Index Tools aims to be the most powerful and advanced SEO addon for Xenforo, hands down. Virtually every idea and method collected from years of experience has been going into this product, with no shortcuts taken.
What are the major features?
- Powerful indexing management with advanced rules & criteria
- Meta tags with Google snippet previews
- Open Graph management
- Page title formatting
- Image and link tag management, alt and title attributes
- rel="nofollow" handling
- Deep 3rd-party support for addons and other systems
What is indexing?
Search engine indexing is whether or not pages are included in search results, such as in Google or Bing, or blocked to these search engines. "Noindexing" a page means it will not be included in search results. It also affects your site's ranking and search placement.
Why should you "index" or "noindex" content?
Typically, you don't want "junk" content or pages which offer no valuable text content or keywords, to be shown in Google. Rather, the goal is to only include valuable pages which you want people to click to visit your site. Think threads, your homepage, useful articles, etc. If a user makes a @#$%-post about "Look at this funny cat", chances are you don't want this in Google search results!
Can indexing affect my site's rank?
This is complicated, but YES! At the very simplest, by including tons of junk URLs in your search results, you're diluting the authority & positioning of your important pages. This can ultimately affect the overall Domain Authority of your website itself.
By blocking search engines to junk pages via the "noindex" or "nofollow" directives, you theoretically should cause a bump in the rank of your important content.
Why the need for powerful indexing in Xenforo? Does this already affect me?
By using Xenforo, the answer is already yes. This is not a knock or slight against Xenforo which is a fantastic system, but by nature the platform can produce countless low-value URLs and redirects which can and should be blocked from search engines. Is this a problem with Xenforo? Not really. Remember that the standpoint of this addon is from a hyper-aggressive and in-depth approach to technical SEO, for site owners looking for that power and control. I don't personally believe such an aim rests on Xenforo as a general community platform, especially when so many of these SEO decisions should ultimately be on a case-by-case basis.
SEO & Index Tools introduces an incredibly in-depth system for index management. First, let's see how it overhauls Xenforo's thread indexing - so it will make sense when explaining how this system extends to other parts of Xenforo!
First, index settings and criteria have been migrated off the 'Forum' entity and onto the 'Node' entity itself, which means other type of nodes such as Categories and Pages are now affected! This alone has huge benefit. Not only can you control indexing of category pages, but the indexing of all content under the category (including subforums) by setting criteria on the category itself! Further, you can noindex Page nodes, which is very crucial for sites with many custom pages for non-forum based content.
Setting criteria on the category? Yup, that means INHERITANCE
I'm personally a big fan of Xenforo's nested set functionality, and use it in several addons. Nested set allows settings for certain Xenforo entities to be extended down child items, such as forums, skipping only when there's a setting already made. A good example of this is "Override style ID" for forums or categories, which extends down all the subforums.
I'm also a fan of automation and making things simple with addons, so index settings are now inherited. For example, you can simply set one of your top-level categories to "noindex", and it will affect all subforums, pages and threads within it! The same applies to whether you've set criteria, such as "Minimum reaction score". That criteria is also passed down the chain of nodes.
This method uses an "index_criteria" and "effective_index_criteria" combo on the node entity, where the effective value is the definitive after checking parent values
Advanced note #2:
Index settings are copied off the Forum entity during install and translated onto the Node entity where it makes sense to do so. If nothing is set, it will default to the new 'Inherit' value which will typically mean "Index". Settings are back-translated where possible onto the Forum entity on uninstall.
Seeing the index system visually:
For convenience, the addon shows the index rules for each node on the Admin -> Forums -> Nodes list:
As you can see, rules set at the category level are inherited unless given an explicit value.
So what else can we do here?
What's more, you can even choose to count the total words per page from either the entire page (all posts counted together!) or by limiting from the first X posts of a thread. SEO & Index Tools will count the words from the message content of posts (not the overall page), after stripping BBCode and HTML tags.
Ok, so that's pretty cool. But what about if you have a large number of nodes? Don't worry, that's been handled.
Now with these handy settings done, we can go back to our forums/nodes and find that there's a new option added, to use the global criteria!
This means that after installing the addon, you can simply set your global criteria and then assign all top-level categories to use this setting, effectively taking care of all your forums in a few clicks. No wasting time! There will likely even be a "Rebuild / assign global criteria" entry in the Tools section at release, to take care of this for you!
So we've looked at how indexing is overhauled and extended using the addon. But that's just the beginning..
This includes the inheritance system, application of the criteria system onto these entities, category settings, etc, including the visualization of the index inheritance on Admin category listings.
Indexing for Resource Categories:
Criteria also mimics the forum settings, but takes into account differences for the content. For example, Media items will have "Minimum X words" taken from the media description, Products from their descriptions, etc.
But what if you apply pretty good index criteria, but there's still content which meets the rules that you don't want indexed? You can also manually control individual content from the mod menu! For example, here we change a single thread:
You can even manage this from the forum list using inline moderation!
Whether Media Gallery photos, products, resources or news articles, SEO & Index Tools applies its powerful indexing features across the board!
This feature alone can have enormous potential in reducing the amount of low SEO value URLs on your site, particularly when having a large number of members, product or resource update pages, etc.
The next powerful feature in the addon is the live Google snippet preview, which shows an approximation of how your page will appear in search results, and updates as you type in the fields! By default, the preview will use the regular title and description for the content - whether a forum or category, resource category, XenPorta section.
The live preview also adds two optional fields to all supported content, an SEO meta title and description. This allows you to specify custom content to display in the <head> section of your page (which will be visible to Google and search results), while keeping the regular title and <h1> tag on your page for visitors.
Also, when entering text into the SEO fields, it will override the standard values!
View attachment Sequence 01.mp4
Further, you can supply a custom Open Graph image, which will display to the left of the Google snippet. And of course, several handy labels will change colors from green to red and alert you for optimal character count as you type!
The advised lengths for optimal title and description are also set in the Options, with default values being recommended lengths by Google). Again, no shortcuts, always full control.
- Forum list
- XFRM overview
- XFRM categories & resources
- XFMG overview
- XFMG categories & media pages
- Chat/shout pages
- eCommerce software (XR Product Manager, DBTech eCommerce, XFA Marketplace etc)
- XenPorta overview, categories & articles
- Other news/article addons
My Favorite Books | All About Books - A Book Lover's Haven
This can get a bit cumbersome when your site name is lengthy, and in fact uses a lot of character count and possibly keyword repetition in ALL of your page titles. For example, a handful of your threads could look like this:
Nice Poems | All About Books - A Book Lover's Haven
Best of the month | All About Books - A Book Lover's Haven
Fun reads | All About Books - A Book Lover's Haven
With SEO & Index Tools, you can assign custom suffixes for each area of your site - and even inject the name of the category for SEO boost!
The live preview will show how your browser tab would appear. This can be very handy for using a shortened suffix when you want the page's title to take the most space, or showing the category name.
For example, we could change the thread from earlier to simply:
..or with the forum category..My Favorite Books | All About Books
My Favorite Books | What Are You Reading | All About Books
Further, you can configure the options to limit the entire page title to a certain amount, ie 70 characters. This method is intelligent enough that it will retain the suffix while cropping the content title with ellipsis (...).
Remember, this addon is all about giving you FULL control.