S.A.F.A.R.I (Slavik's Amazingly Fast And Responsive Importer) [vB4] [Paid] [Deleted]
- Thread starter Slavik
- Start date
- Status
PMed
kontrabass
Well-known member
Does this import paid subscriptions from VB4?
Stuart Wright
Well-known member
Slavik is the importer very server intensive? If I kick it off on the AVForums live servers, should I have a concern that the importer will it slow down the forums significantly?
Jarod
Active member
Not particularly, I did all the test imports on my live board and nothing was noticed.
To ensure the database schemas are applied in the correct order.
kontrabass
Well-known member
My server runs out of room in /tmp when running ExportFS.php. Can I use a simple "find and replace" to change /tmp to a different directory? My /tmp mount only has 8GB.
Yes
Jeremy
in memoriam 1991-2020
A fresh install of v1.1.4 will have all the schemas correctly 'applied' already. This seems like an unnecessary step. And if it doesn't apply them correctly (or you 'need' to upgrade), you should be reporting it as a bug.
kontrabass
Well-known member
Holy gee wilikers! This thing actually works. I've invested many hours tweaking it for our boards - the only reason many hours and not a one or two hours, is because I'm a php/mysql amateur at best. But with Slavik's help I was able to squash the bugs. And now I have a live sandbox up of TalkBass running on XenForo!
Export time: Grand Total For Everything: 71 minutes, 31 seconds (47,647,137 records)
Import time: Import Total Time: 8,571.35s)...
This is for a board with 13M posts, 200k+ users, 200k+ attachments (25GB) in the filesystem. The sandbox server has dual intel SSD's in RAID 1, and a Xeon E3-1230 ivy bridge @ 3.3GHZ
A couple of the fixes I did are related to our archaic database schema (for example our "location" user profile field is in a different place than a stock vbulletin install etc). I fixed a couple lines so that the post reports and post report comments are exported correctly. And I fixed one line so that it seems to work with a XF 1.4 install (vs installing 1.0 first and then upgrading).
Next step, configure the export file to handle our custom user profile fields...
Export time: Grand Total For Everything: 71 minutes, 31 seconds (47,647,137 records)
Import time: Import Total Time: 8,571.35s)...
This is for a board with 13M posts, 200k+ users, 200k+ attachments (25GB) in the filesystem. The sandbox server has dual intel SSD's in RAID 1, and a Xeon E3-1230 ivy bridge @ 3.3GHZ
A couple of the fixes I did are related to our archaic database schema (for example our "location" user profile field is in a different place than a stock vbulletin install etc). I fixed a couple lines so that the post reports and post report comments are exported correctly. And I fixed one line so that it seems to work with a XF 1.4 install (vs installing 1.0 first and then upgrading).
Next step, configure the export file to handle our custom user profile fields...
Blackbeard
Well-known member
TalkBass is running 3.6...so I assume this worked instead of upgrading to 4.0- first?
kontrabass
Well-known member
No, I upgraded the db to 4.2.0 first. Takes all of 10 minutes via the vbulletin command-line upgrade.php. That's a far easier solution than trying to tweak this importer to handle 3.6's attachment system.
Gladius
Well-known member
Hm, I read various accounts of the vB3-4 upgrades taking ages... I know CLI would be much faster, but it seems odd that it'd be that fast for a board that large.
It'd be great if we could skip the upgrade to v4 before importing, though. What exactly is the problem with handling v3's attachments and avatars?
It'd be great if we could skip the upgrade to v4 before importing, though. What exactly is the problem with handling v3's attachments and avatars?
- Status