1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How are bigboards importing to XF?

Discussion in 'XenForo Pre-Sales Questions' started by NolF, Nov 17, 2010.

  1. NolF

    NolF Active Member

    By bigboards I mean lots of users and threads/posts. I have 400k users and almost 2million posts, and I cannot import smoothly.

    My internet is not the most reliable of things, and compounded with having the server in the US when I'm in Australia results in many packets lost which in tern mean the upgrade process does not continue because the browser shows an error (timing out).

    Is there some sort of script that can be run from the server itself (I have a dedicated server)? It should be quicker and more reliable.

    I'm also wondering how do you make it seamless or reduce the downtime? Importing the table script took me over 12 hours (2Gbs), albeit the dropping pages did not help the process. You then have to add private messages, visitor messages, and the users themselves.
  2. Itworx4me

    Itworx4me Well-Known Member


    Could happen....lol
  3. Elizabeth

    Elizabeth Well-Known Member

  4. Walter

    Walter Well-Known Member

    I've done many vb upgrades, nearly half of them with the server on another continent and never had problems. But if you face packet loss your provider has a serious problem (either your ISP or your host).

    And how does your server do during the import? Where is the bottleneck? CPU? Disks?
  5. NolF

    NolF Active Member

    The dropped packets (mostly affect page requests) and it's due to some sort of incompatibility of the modem/router with the ISP. I'm in the process of getting a much better one which should address those concerns.

    Regarding the process itself, I don't think there is a bottle neck :S Not sure how I would know. Server load is low <1, I have a Q6600 and the server has to SAS 36Gb in Raid1

    Attached Files:

  6. Elizabeth

    Elizabeth Well-Known Member

    Check out WiredTree
  7. Dean

    Dean Well-Known Member

    NoIF - I'm not an expert on servers but it looks to me like you server is not working hard at all. 85% idle, not waiting on hardware...
  8. NolF

    NolF Active Member

    I've switched to opera with turbo mode on for the import process, and it hasn't timed out on me yet as chrome does. Quite interesting :) Still, a very slow process :(

    I can't afford their dedicated services as the configuration I have would cost far more than the monthly budget (paying ~250/month including management), and I don't think a VPS would suffice my requirements :/

    That's what is bugging me, so many resources sitting idly...
  9. Elizabeth

    Elizabeth Well-Known Member

    I'm paying less than $200 for a dedicated. It would be worth contacting the sales department and asking them.
  10. Anthony Parsons

    Anthony Parsons Well-Known Member

    Not really about whether it runs low or not though... more that the resources are there for the peaks, and with over 2 million posts and 400k of users... peaks would suffice often for the solution you have, otherwise you would endup constantly locking up under a little load.
  11. AlexT

    AlexT Well-Known Member

    NolF and Anthony Parsons like this.
  12. D.O.A.

    D.O.A. Well-Known Member

    I set up a server at home on a decent PC with linux, downloaded the old forums backup and did it all from there, reuploaded the new/old vb attachments created by xenforo and imported the new database online
  13. NolF

    NolF Active Member

    Ideally that's what I would like to have. It seems to make sense to be honest

    My home internet is only 6/1mbps downloading processing (on a laptop) and uploading 5Gbs (including attachments) it's way too slow and cumbersome and slow.
  14. D.O.A.

    D.O.A. Well-Known Member

    sorry to hear :(

    I'm an aussie too, but bigpond cable :D

    I'm just gonna add another sad face cause my internet bill arrived :(
  15. AdamD

    AdamD Well-Known Member

    Hmm, I have a dual processor, quad core machine, with 12gb of ram, if you wanna borrow that do to the import?
    Let me know if so.
  16. My forum is only modest, but i did have a 200mb attachment table to handle, the only way i could get it to work was to use a proper mysql client to connect to the old database, export it, put it back very close to the new database (same server) and then run the importer, that handled it ok in beta 3.

    A few things still need work, for example if you try and delete a forum with alot of subforums the job timesout.
  17. NolF

    NolF Active Member

    Thanks for your kind generosity, since using Opera, the upgrade process seems to have become much more reliable and faster. According to the Admin panel, 100k posts/threads imported in 5 hours, though if I go to phpmyadmin, it shows 2million posts and 2Gbs as I would expect. Weird... Importing the private messages is just as wierd though. It says 0.01% imported, back looking at the back end about 50% seems to have been imported.

    Yep, that bug seems to have stayed in beta3, we can always hide them in the mean time though :)

    Anyways hopefully this import works out well, and I can ditch vbulletin as I'm getting some serious database errors every time I open the board :(

Share This Page