Resource icon

vBulletin Big Board Importer [vBulletin 3 + vBulletin 4] [Paid] 1.5.0

No permission to buy ($150.00)
Overview Updates (9) Reviews (3) History Discussion
Just running export.php it still seems to be running but I am getting these errors:

Code: 
 Make Selection [1-9]: 9

exporting posts...
          [forking process for posts]
          post IPs (1,676 records in 0.14s)...
         vbseo likes (2,448,384 records in 5.53s)...
          reported posts (0 records in 6.90s)...
          reported post comments (0 records in 6.74s)...
          reported profile posts (0 records in 0.09s)...
          reported profile post comments (0 records in 0.09s)...
          reported private messages (0 records in 0.06s)...
          reported private message comments (0 records in 0.06s)...
          post edit history (30,301 records in 5.11s)...
Total time for posts: 24.77s

exporting users...
          [forking process for users & user authenticate]
          user external auth (0 records in 0.08s)...
          user follow (135,292 records in 0.18s)...
          user ignored (3,164 records in 0.09s)...
          user options (866,648 records in 3.88s)...
          user profile (866,648 records in 36.34s)...
          user privacy (866,648 records in 4.52s)...
          user warnings (1,415 records in 0.16s)...
          user bans (132,819 records in 5.51s)...
          warning action triggers (132,819 records in 3.40s)...
          skipping user fields          user registration IPs (866,648 records in 5.19s)...
          user account confirmation IPs (198,168 records in 1.99s)...
          user change log IPs (786,359 records in 2.30s)...
          profile posts (103,095 records in 1.89s)...
          profile post IPs (301,263 records in 0.59s)...
          user upgrades active (0 records in 0.03s)...
          user upgrades expired (228 records in 0.03s)...
          user upgrades log (166 records in 0.03s)...
Total time for users: 66.20s
*** Don't forget to rebuild user cache ***


exporting threads...
          [forking process for threads]
          watched threads (1,356,062 records in 1.32s)...
          thread user post (3,632,097 records in 6.73s)...
          polls (114,806 records in 3.82s)...
          thread read (49,275 records in 0.28s)...
Total time for threads: 12.15s
*** Don't forget to rebuild poll cache ***


exporting private messages...
          [forking process for conversation master]
          conversation message (269,921 records in 31.68s)...
          conversation recipient (482,530 records in 5.67s)...
          conversation user          skipping private conversation IPs
Total time for private messages: 40.64s

performing avatar diff...
         59,871 users with new avatars
libpng warning: tRNS chunk has out-of-range samples for bit_depth
libpng warning: tRNS chunk has out-of-range samples for bit_depth
libpng warning: tRNS chunk has out-of-range samples for bit_depth

rm: cannot remove `/opt/www/ru/xf/importData/xf_post_*': No such file or directory
split: cannot open `/opt/www/ru/xf/importData/xf_post.txt' for reading: No such file or directory
An unexpected error occurred. Please try again later.

The last error is what is most concerning.
 
After the unexpected error it still kept going for about another 10 minutes and then received this :
Code: 
libpng warning: Incorrect sBIT chunk length
libpng warning: Incorrect sBIT chunk length
libpng warning: Incorrect sBIT chunk length
<pre>
data/avatars/s/0/1.jpg => No move
data/avatars/s/0/473.jpg => No move
data/avatars/s/0/481.jpg => No move
data/avatars/s/0/486.jpg => No move
data/avatars/s/0/490.jpg => No move
data/avatars/s/0/495.jpg => No move
data/avatars/s/0/496.jpg => No move
data/avatars/s/0/499.jpg => No move
data/avatars/s/0/501.jpg => No move
data/avatars/s/0/504.jpg => No move
data/avatars/s/0/506.jpg => No move
data/avatars/s/0/513.jpg => No move
data/avatars/s/0/522.jpg => No move
data/avatars/s/0/525.jpg => No move
data/avatars/s/0/540.jpg => No move
data/avatars/s/0/551.jpg => No move
data/avatars/s/0/554.jpg => No move
data/avatars/s/0/559.jpg => No move
data/avatars/s/0/565.jpg => No move
data/avatars/s/0/575.jpg => No move
data/avatars/s/0/608.jpg => No move
data/avatars/s/0/617.jpg => No move
data/avatars/s/0/622.jpg => No move
data/avatars/s/0/625.jpg => No move
data/avatars/s/0/627.jpg => No move
data/avatars/s/0/652.jpg => No move
data/avatars/s/0/672.jpg => No move
data/avatars/s/0/684.jpg => No move
data/avatars/s/0/702.jpg => No move
data/avatars/s/0/712.jpg => No move
data/avatars/s/0/723.jpg => No move
data/avatars/s/0/738.jpg => No move
data/avatars/s/0/739.jpg => No move
data/avatars/s/0/748.jpg => No move
data/avatars/s/0/749.jpg => No move
data/avatars/s/0/758.jpg => No move
data/avatars/s/0/759.jpg => No move
data/avatars/s/0/781.jpg => No move
data/avatars/s/0/795.jpg => No move
data/avatars/s/0/806.jpg => No move
data/avatars/s/0/831.jpg => No move
data/avatars/s/0/851.jpg => No move
data/avatars/s/0/869.jpg => No move
data/avatars/s/0/873.jpg => No move
data/avatars/s/0/877.jpg => No move
data/avatars/s/0/878.jpg => No move
data/avatars/s/0/884.jpg => No move
data/avatars/s/0/916.jpg => No move
data/avatars/s/0/921.jpg => No move
data/avatars/s/0/928.jpg => No move
data/avatars/s/0/934.jpg => No move
data/avatars/s/0/940.jpg => No move
data/avatars/s/0/942.jpg => No move
data/avatars/s/0/963.jpg => No move
data/avatars/s/0/966.jpg => No move
data/avatars/s/0/982.jpg => No move
<pre>
data/avatars/m/0/1.jpg => No move
data/avatars/m/0/473.jpg => No move
data/avatars/m/0/481.jpg => No move
data/avatars/m/0/486.jpg => No move
data/avatars/m/0/490.jpg => No move
data/avatars/m/0/495.jpg => No move
data/avatars/m/0/496.jpg => No move
data/avatars/m/0/499.jpg => No move
data/avatars/m/0/501.jpg => No move
data/avatars/m/0/504.jpg => No move
data/avatars/m/0/506.jpg => No move
data/avatars/m/0/513.jpg => No move
data/avatars/m/0/522.jpg => No move
data/avatars/m/0/525.jpg => No move
data/avatars/m/0/540.jpg => No move
data/avatars/m/0/551.jpg => No move
data/avatars/m/0/554.jpg => No move
data/avatars/m/0/559.jpg => No move
data/avatars/m/0/565.jpg => No move
data/avatars/m/0/575.jpg => No move
data/avatars/m/0/608.jpg => No move
data/avatars/m/0/617.jpg => No move
data/avatars/m/0/622.jpg => No move
data/avatars/m/0/625.jpg => No move
data/avatars/m/0/627.jpg => No move
data/avatars/m/0/652.jpg => No move
data/avatars/m/0/672.jpg => No move
data/avatars/m/0/684.jpg => No move
data/avatars/m/0/702.jpg => No move
data/avatars/m/0/712.jpg => No move
data/avatars/m/0/723.jpg => No move
data/avatars/m/0/738.jpg => No move
data/avatars/m/0/739.jpg => No move
data/avatars/m/0/748.jpg => No move
data/avatars/m/0/749.jpg => No move
data/avatars/m/0/758.jpg => No move
data/avatars/m/0/759.jpg => No move
data/avatars/m/0/781.jpg => No move
data/avatars/m/0/795.jpg => No move
data/avatars/m/0/806.jpg => No move
data/avatars/m/0/831.jpg => No move
data/avatars/m/0/851.jpg => No move
data/avatars/m/0/869.jpg => No move
data/avatars/m/0/873.jpg => No move
data/avatars/m/0/877.jpg => No move
data/avatars/m/0/878.jpg => No move
data/avatars/m/0/884.jpg => No move
data/avatars/m/0/916.jpg => No move
data/avatars/m/0/921.jpg => No move
data/avatars/m/0/928.jpg => No move
data/avatars/m/0/934.jpg => No move
data/avatars/m/0/940.jpg => No move
data/avatars/m/0/942.jpg => No move
data/avatars/m/0/963.jpg => No move
data/avatars/m/0/966.jpg => No move
data/avatars/m/0/982.jpg => No move
<pre>
data/avatars/l/0/1.jpg => No move
data/avatars/l/0/473.jpg => No move
data/avatars/l/0/481.jpg => No move
data/avatars/l/0/486.jpg => No move
data/avatars/l/0/490.jpg => No move
data/avatars/l/0/495.jpg => No move
data/avatars/l/0/496.jpg => No move
data/avatars/l/0/499.jpg => No move
data/avatars/l/0/501.jpg => No move
data/avatars/l/0/504.jpg => No move
data/avatars/l/0/506.jpg => No move
data/avatars/l/0/513.jpg => No move
data/avatars/l/0/522.jpg => No move
data/avatars/l/0/525.jpg => No move
data/avatars/l/0/540.jpg => No move
data/avatars/l/0/551.jpg => No move
data/avatars/l/0/554.jpg => No move
data/avatars/l/0/559.jpg => No move
data/avatars/l/0/565.jpg => No move
data/avatars/l/0/575.jpg => No move
data/avatars/l/0/608.jpg => No move
data/avatars/l/0/617.jpg => No move
data/avatars/l/0/622.jpg => No move
data/avatars/l/0/625.jpg => No move
data/avatars/l/0/627.jpg => No move
data/avatars/l/0/652.jpg => No move
data/avatars/l/0/672.jpg => No move
data/avatars/l/0/684.jpg => No move
data/avatars/l/0/702.jpg => No move
data/avatars/l/0/712.jpg => No move
data/avatars/l/0/723.jpg => No move
data/avatars/l/0/738.jpg => No move
data/avatars/l/0/739.jpg => No move
data/avatars/l/0/748.jpg => No move
data/avatars/l/0/749.jpg => No move
data/avatars/l/0/758.jpg => No move
data/avatars/l/0/759.jpg => No move
data/avatars/l/0/781.jpg => No move
data/avatars/l/0/795.jpg => No move
data/avatars/l/0/806.jpg => No move
data/avatars/l/0/831.jpg => No move
data/avatars/l/0/851.jpg => No move
data/avatars/l/0/869.jpg => No move
data/avatars/l/0/873.jpg => No move
data/avatars/l/0/877.jpg => No move
data/avatars/l/0/878.jpg => No move
data/avatars/l/0/884.jpg => No move
data/avatars/l/0/916.jpg => No move
data/avatars/l/0/921.jpg => No move
data/avatars/l/0/928.jpg => No move
data/avatars/l/0/934.jpg => No move
data/avatars/l/0/940.jpg => No move
data/avatars/l/0/942.jpg => No move
data/avatars/l/0/963.jpg => No move
data/avatars/l/0/966.jpg => No move
data/avatars/l/0/982.jpg => No move

Total time for avatars: 2,336.56s
An unexpected database error occurred. Please try again later.
<!-- Mysqli prepare error: MySQL server has gone away -->[ru@ru-web1 xf]$
 
I am trying to import my attachments and had to fix a few errors for my system on the Export.php, I got it all working but its saying 727 new attachments. How can I reset the data for Export.php and grab all fresh data.
 
Also one more thing, once we have everything imported to Xenforo and are ready for the final switch. Do we run the Export.php and then import.php one final time to get all the final data ? Or would it require a reset of all the data and a fresh import.
 
Chris Shortreed said:
I am trying to import my attachments and had to fix a few errors for my system on the Export.php, I got it all working but its saying 727 new attachments. How can I reset the data for Export.php and grab all fresh data.
Click to expand...

Attachments are incremental, meaning it only imports new ones since the last run of Export.php. There is really no need to import all attachments every time.

Chris Shortreed said:
Also one more thing, once we have everything imported to Xenforo and are ready for the final switch. Do we run the Export.php and then import.php one final time to get all the final data ? Or would it require a reset of all the data and a fresh import.
Click to expand...

Run both again. A fresh install is not required.
 
No what I mean is that we should have way more then 722 attachments to import, I think when it couldn't find the attachments and its incremental on attachments I need to flush the attachments that have already been converted and start fresh.
 
Jake:
Code: 
Make Selection [1-9]: 6

         717 new attachments
268 269 270 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 298 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 ^C

There should be a lot of attachments, that need to be imported we have 300G so I think its best to start fresh and not do an incremental, how would I got about doing this. The no move error was because our gluster was not mounted properly on the new server. Now all the attachments are there.

SELECT MAX(attachment_id)
FROM xf_attachment
Returns 318

SELECT MAX(attachmentid) FROM attachment
Returns 3032414
 
Last edited:
Chris Shortreed said:
No what I mean is that we should have way more then 722 attachments to import, I think when it couldn't find the attachments and its incremental on attachments I need to flush the attachments that have already been converted and start fresh.
Click to expand...

Attachments are incremental meaning it only imports new attachments since the last run. If you want to run them all again then empty xf_attachment and xf_attachment_data, and delete the attach directories inside of data and internal_data.
 
Is there a faster way to speed up attachment moving, its copying all the attachments to the import directory its been running for several hours now and only on 141k of 3M
 
Chris Shortreed said:
Is there a faster way to speed up attachment moving, its copying all the attachments to the import directory its been running for several hours now and only on 141k of 3M
Click to expand...

3 million attachments? That is beyond excessive. You can expect that to take a long time. Rough guesstimate would be 48 hours. But because attachments are incremental you will only have to endure that once.
 
Slavik said:
Should work fine IIRC none of the tables we import to got updated.
Click to expand...
Thanks. All purchased, I'll start playing with it this week.

We've got about 3m posts and 80k members. Sure didn't want to take my production site down for a day while the web importer finished.
 
Chris Shortreed said:
im 48 hours into exporting attachments got another 1m to go or so, just be prepared for that.
Click to expand...
Yeah... I have 35k attachments. Probably won't be quite the problem that you're having. Good luck - your members must love their attachments!

Running my beta -> beta test tonight!
 
You must log in or register to reply here.

Similar threads

M
  • Question Question
XF 2.2 XF2 CLI import vs vBulletin Big Board Importer
Replies
1
Views
527
Slavik
Slavik
Slavik
vBulletin Big Board Importer for XenForo 2 [vBulletin 3 & vBulletin 4] [Deleted]
Replies
1
Views
810
Slavik
Slavik
Steffen
vBulletin 3/4 Moderator Log Import Command
Replies
0
Views
964
Steffen
Steffen
Kier
  • Question Question
XF 2.0 vBulletin 4 with Blog importer - known issue
Replies
8
Views
17K
Universal4
U
Mr Lucky
  • Question Question
XF 1.5 Redirect from vBulletin 3 and vBulletin 4
Replies
1
Views
489
Mr Lucky
Mr Lucky
Back
Top Bottom