1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Feedback: conversion of a vBulletin forum with 2.8 million posts

Discussion in 'XenForo Pre-Sales Questions' started by Walter, Oct 23, 2010.

  1. Walter

    Walter Well-Known Member

    For testing purposes I converted a forum with 2.8 million posts from vBulletin 3.8 to Xenforo.

    For a forum of that size I was interested in seeing four things:
    1. If the conversion went well and
    2. how long it took,
    3. what the forums database size would be and
    4. if search was ok without using any hacks or Sphinx
    Here are my experiences: while Beta 1 had troubles converting the users Beta 2 seemed to work fine, but it failed later while converting the forum posts. Fortunately Mike was so kind to post a fix for that here and the import finally worked and my questions are all answered:

    1. Everything was converted well, at least everything I expected (of course blog and posts in social groups are currently not supported). Even umlauts :)
    2. Due to the problems during converting the posts I don't have exact times but the import took under 24 hours. After that I rebuilt the search index which took only a few hours (about 11 pm to maybe 7 am) - that is quite fast considering that it created a search index table with 6 GB of data!
    3. Database size is quite larger, vBulletin was at 6.1 GB in 202 tables and XenForo is at 9.4 GB in 119 tables. Most of the 9.4 GB is used by the search index, an astonishing 6 GB.
    4. I made no scientific tests but playing with the search function and trying different kinds of searches (e.g. posts or titles only) it seems that XenForo is at least as fast as vBulletin 3.8 (stock vb, no Sphinx or other hacks). I guess I can improve search speed further with tuning mySQL specifically for Xenforo.
    I hope that this is of some help. The converter seems quite stable (at least with the fix from above applied). There are still a few features missing before I can convert that particular forum (an alternative for the blogs and heavily used social groups, a picture gallery) but it's quite impressive what Kier and Mike have delivered.

    Regarding the quite fast import: please consider that this was done with a server with a very good disk system (8x SAS RAID10) which is a major factor. CPU isn't such a big concern (server had only a single Xeon 3220). Nevertheless, the import was done while the server was under load. Having a good disk subsystem and optimized mySQL goes far.
     
    laztrix, Photon, FreshFroot and 10 others like this.
  2. Brogan

    Brogan XenForo Moderator Staff Member

    Great news Walter!

    That bodes well for the future :)
     
  3. Floris

    Floris Guest

    Excellent Walter! Thanks for posting. Nice to read big-boards converting over just fine.
     
  4. tonjohn

    tonjohn Member

    What I am most curious about is the difference in perf between vb and xf given various user loads (example/ at 3,500 users, 10k users, and 20k users).
     
    Xarcell likes this.
  5. Xarcell

    Xarcell Well-Known Member

    Same here.
     
  6. FreshFroot

    FreshFroot Well-Known Member

    Thanks for the stats. Seems like XF is improving beta by beta. Can't wait to see what Beta 3 has in store for us :D
     
  7. Erp

    Erp New Member

    Facepunch is going to get a labs up with XenForo and currently contains:
    Threads
    251,826
    Posts
    9,835,469
    Members
    165,659
     
    Darkimmortal likes this.
  8. jonsidneyb

    jonsidneyb Well-Known Member

    Great job Walter
     
  9. diaz

    diaz New Member

    you can't convert FP, compwhizii just switched it and garry wants to stay with vB
     
  10. Erp

    Erp New Member

    Not from what I've heard today...
     
  11. jonsidneyb

    jonsidneyb Well-Known Member

    I wanna see too.
     
    FreshFroot likes this.
  12. hescominsoon

    hescominsoon Active Member

    what mysql optimizations did you perform?
     
  13. Walter

    Walter Well-Known Member

    Currently no Xenforo specific ones as I still don't know XF good enough.
    The other optimizations are the usual ones: try to keep tmp tables in memory, sufficient key buffer, table cache,...
     
  14. hescominsoon

    hescominsoon Active Member

    so basically tons of ram and lots of caching..:)
     
  15. Walter

    Walter Well-Known Member

    Balanced. But RAM is of great help for every DB.
     
  16. Andy.N

    Andy.N Well-Known Member

    Would having a separate server for database help?
    I'm thinking of getting one for future growth.
     
  17. Walter

    Walter Well-Known Member

    Definitely helps because this way you can optimize one server for web and one fot the DB and don't have to make compromizes. An extra database server usually is able to keep either all or at least the most important part of the db in memory which speeds things up dramatically.
     

Share This Page