1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

XF 1.2 vB4 -> xF migration and Seo effect

Discussion in 'XenForo Questions and Support' started by giorgino, Sep 12, 2013.

  1. giorgino

    giorgino Well-Known Member

    Iv'e just migrated a forum from vB4 to xF 1.5 in april... and the indexed pages are decreased a lot.
    The forum count 36.000+ users and 150.000 posts.

    Any advice?

    Schermata 2013-09-12 alle 14.04.57.png
  2. giorgino

    giorgino Well-Known Member

  3. Parminder Singh Chahal

    Parminder Singh Chahal Active Member

    Did you redirect your old urls to the new xenforo links?
    giorgino likes this.
  4. Parminder Singh Chahal

    Parminder Singh Chahal Active Member

    Also you have this line in your robots.txt file :

    Disallow: /forums/-/

    Any specific reason why you have it there?
    giorgino likes this.
  5. giorgino

    giorgino Well-Known Member

    Yes, anyway after more than 5 months the new urls are indexed...

    Nope. I've copied the robots.txt here on xf.com...

    This is the graph with "blocked by robot" in orange...

    Schermata 2013-09-12 alle 15.24.22.png

    As you can see, only 5/6.000 urls are blocked by robots.txt...
    Where are the other 70/80.000 URL's? :(
  6. Weppa333

    Weppa333 Active Member

    Anything I search on your board (choosing an old thread from a random forum and copy pasting text from it inside google) gets a result in google, so your pages are indeed crawled and indexed.

    The question is more, what were the previous 80000 URLs ?
    VB has a specialty in multiplying the same content all over the web (the infamous printthread, single messages pages, etc)
    giorgino likes this.
  7. Weppa333

    Weppa333 Active Member

    Google reports 134,000 pages indexed for your board, at this time.
    Forget this graph.

    Do you see a major drop of trafic ?
    giorgino likes this.
  8. giorgino

    giorgino Well-Known Member

    I don't agree.
    I've 22.522 threads. Where are in index results?

    there are only 819 results o_O
    Where are the other 20K threads? :eek:

    Last edited: Sep 12, 2013
  9. Parminder Singh Chahal

    Parminder Singh Chahal Active Member

    I would advise you to take this line off : Disallow: /forums/-/ This is very important and should be done right away.

    Also consider adding /members there to the disallow list as you have restricted guests from viewing member profiles. You can allow Google media if you have ads on there.
    giorgino likes this.
  10. giorgino

    giorgino Well-Known Member

    YES! :(

    Schermata 2013-09-12 alle 15.42.37.png
  11. Weppa333

    Weppa333 Active Member

    Actually you board is (now) at PROPIT.IT not at www.propit.it as far as google is concerned

    the indexed page graph you're showing is probably referring to www.propit, you probably did change something in your config (remove www) along with swtiching to XF

    Currently you clearly have double content, www and without WWW serve the same thing ( bad)
    giorgino likes this.
  12. Parminder Singh Chahal

    Parminder Singh Chahal Active Member

    That is mainly because of that line in your robots.txt. Take it off and give it "3" days and dont forget to update this thread how it went.
    giorgino likes this.
  13. Weppa333

    Weppa333 Active Member

    site: propit.it report 134K result

    site:www.propit.it reports... 5000 rsults, and lowering at each reload.

    You're in a double content situation, and google chose to index "propit.it" for whatever reasons. It probably punished you for double content. The migration probably didn't help either.

    SEO is a job :) (PS Mike, /posts/ is gonna kill you someday :) )
  14. giorgino

    giorgino Well-Known Member

    Now my robots.txt is

    User-agent: Mediapartners-Google
    User-agent: *
    Disallow: /scripts/
    Allow: /
    User-agent: Googlebot
    Disallow: /find-new/
    Disallow: /account/
    Disallow: /attachments/
    Disallow: /goto/
    Disallow: /posts/
    Disallow: /login/
    Disallow: /admin.php
    Disallow: /ajax/
    Disallow: /conversations/
    Disallow: /lost-password/
    Disallow: /misc/style?*
    Disallow: /misc/quick-navigation-menu?*
    Disallow: /online/
    Allow: /
    Sitemap: http://www.immobilio.it/sitemap/sitemap.xml.gz
    Uh o_O

    So what I can change? xf Board URL or Google webmaster preferences? :notworthy:
  15. Weppa333

    Weppa333 Active Member

    The content is there, and /forum/-/ cannot really hurt but should be removed.

    Don't get me started about /posts/ either :) But it seems XF's team has made their decision. Anyway.

    Giorgino, the first thing you have to do is decide what URL you want. I fyou switch "back" to www.propit.it you are gonna kill your traffic for another 6 months, this has to be taken into account.
    If you decide to keep the fact that, currently, google knows your board by the name "propit.it" and considers "www.propit.it" as duplicated content, you have to
    - switch www.propit.it off.
    - redirect www.propit -> propit.it ( googlebot is an idiotic piece of garbage that needs a lot of explanations )
    - create a new "google webmaster tools" site for "propit.it" ( not an account, just a new site in your account)

    you should see all your pages there now

    Also make sure of the URLs in your sitemaps, your internal links, etc... There are probably countless implications to your "involuntary switch" of domain names.
    Live Free and giorgino like this.
  16. Parminder Singh Chahal

    Parminder Singh Chahal Active Member

    I believe you should set it to whatever you were using before the move as all the old inlinks must be pointing to that version of your urls. Also check what have you redirected in your .htaccess file.. www or without www because if your board didint have www before and the urls you redirected assumes you had www then you havent ineffect redirected the old url.
    Some one please correct me if I am wrong.
  17. Weppa333

    Weppa333 Active Member

    As I suspected, you have internal links to the "wrong" destination (took me a while to find one of your messages where you are referring to your own board with a link, but here is an example)


    refers to
    (bottom of message)

    So this is... a mess I'm afraid...

    either edit all your internal links and send them back to "propit"

    Or switch AGAIN to www.propit ; but as I said, prepare for a couple of months of no adsense revenues :(

    Googlebot is the most overrated piece of garbage this side of the universe.
    Digital Doctor and giorgino like this.
  18. Parminder Singh Chahal

    Parminder Singh Chahal Active Member

    Your member profiles are not viewable by guests so that also needs to be added to the disallow list in your robots.txt
    giorgino likes this.
  19. giorgino

    giorgino Well-Known Member

    I've to thank you very much Sir... :)
    Added it! :) Thank you Sir :)

    I'll report back in few days for feedback.
    For now, thank you guys very very much!
  20. giorgino

    giorgino Well-Known Member

Share This Page