XF 2.1 Xenforo importer running slowly

[HowardC]

- Step 4 of 26: Avatars 00:00:34 [530]
- Step 5 of 26: Buddy and ignore lists 00:07:43 [20,494]
- Step 6 of 26: Paid subscriptions 00:00:00 [32]
- Step 7 of 26: Custom BB codes 00:00:01 [20]
- Step 8 of 26: Private messages 04:49:42 [1,378,534] 70.63%
- Step 8 of 26: Private messages 07:56:45 [2,247,961]
- Step 9 of 26: Profile comments 00:01:11 [5,387]
- Step 10 of 26: Forums 00:00:21 [554]
- Step 11 of 26: Moderators 00:00:02 [48]
- Step 12 of 26: Thread prefixes 00:00:02 [58]
- Step 13 of 26: RSS feed sources 00:00:00 [1]
- Step 14 of 26: Threads 04:13:21 [317] 0.02%
- Step 14 of 26: Threads 22:08:10 [1,670] 0.10%

I'm experimenting with switching my vBulletin 4 to Xenforo. My forum has close to 20M posts so I knew the importer would take more than a few minutes but at this rate it's going to take more than a year. I made a copy of my forum database on my PC in a virtual machine.

The VM has 4GB of RAM, and resides on an SSD. The VM is running on a stock Ubuntu installation in HyperV. I'm doing the import using the command line.

Am I missing something obvious? I figured it would take a few hours, maybe a day but not this.

 

[TickTackk]

If you are using everything stock then be sure to tune your MySQL installation. Look here, here and here.

 

[Alpha1]

The import process is single threaded. Make sure that the machine has high CPU speed. Multiple CPU's will not be used. There is little difference between a 48 core and a single core. I had the same problem when I imported to XF1. Switching to a fast box with high CPU speed made the difference.

 

[Chris D]

The import process is single threaded by default.

You can spin up multiple processes with the --processes X option when calling the import command.

 

[HowardC]

The import process is single threaded by default.

You can spin up multiple processes with the --processes X option when calling the import command.

Thank you very much. I'll give this a try.