vBulletin Big Board Importer [vBulletin 3 + vBulletin 4] [Paid] 1.5.0

[ehd]

Your not actually giving us any error messages... so can't realy tell you.

If you are getting the xf_post_aa file it means that it has exported the posts database, and started to chop them up into 1 million post files... so things are working there.

Do you have all the pre-req's installed?

OK, I'm a bit stuck at a dead end here.

It didn't work the way the server runs. Now my host installed php 5.4 on a new web on the server.

PHP 5.4.16 (cli) (built: Jun 11 2013 16:10:39)
Copyright (c) 1997-2013 The PHP Group
Zend Engine v2.4.0, Copyright (c) 1998-2013 Zend Technologies

From the info.php:

pcntl
pcntl supportenabled

sudo /opt/php54/bin/php Export.php


!!!WARNING!!! - set charset to 'binary' in XenForo_Application:loadDb()

#################################################
### Digital Point A.R.F.I. vB4 -> XF Importer ###
### Modified by Slavik at www.XenForo.com ###
### with assistance from Mike, Jake and Shawn ###
#################################################
### Notes: ###
### None of the user feilds will be imported ###
### by default. If you want to keep your user ###
### fields these need to be configured in ###
### XenForo first and then mapped at lines ###
### 380-396. ###
#################################################

1 - Posts
2 - Users
3 - Threads
4 - Private Messages
5 - Avatars
6 - Attachments
7 - Forums
8 - Miscellaneous
9 - Everything

Make Selection [1-9]: 9

exporting posts...
[forking process for posts]
post IPs (197 records in 0.06s)...
likes (197 records in 0.01s)...
reported posts (197 records in 0.01s)...
reported post comments (197 records in 0.01s)...
reported profile posts (394 records in 0.01s)...
reported profile post comments (394 records in 0.01s)...
reported private messages (591 records in 0.01s)...
reported private message comments (591 records in 0.01s)...
Total time for posts: 0.12s

exporting users...
[forking process for users & user authenticate]
user follow (197 records in 0.01s)...
user ignored (197 records in 0.01s)...
user options (197 records in 0.01s)...
user profile (197 records in 0.01s)...
user privacy (197 records in 0.01s)...
user warnings (197 records in 0.01s)...
user bans (197 records in 0.01s)...
warning action triggers (197 records in 0.01s)...
skipping user fields user registration IPs (394 records in 0.01s)...
profile posts (197 records in 0.01s)...
profile post IPs (591 records in 0.01s)...
user upgrades active (197 records in 0.01s)...
user upgrades expired (197 records in 0.01s)...
user upgrades log (197 records in 0.01s)...
Total time for users: 0.10s
*** Don't forget to rebuild user cache ***


exporting threads...
[forking process for threads]
watched threads (197 records in 0.01s)...
thread user post (197 records in 0.01s)...
polls

I really don't see any error-messages and the database has all priviliges.

What can be done to get this running?


THanks!

 

[ehd]

I've downloaded all the files from the temp-dir and they are filled with the same output mysql gives......So maybe there is a problem:

mysql Ver 14.14 Distrib 5.1.66, for debian-linux-gnu (x86_64) using readline 6.1
Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Usage: mysql [OPTIONS] [database]
-?, --help Display this help and exit.
-I, --help Synonym for -?
--auto-rehash Enable automatic rehashing. One doesn't need to use
'rehash' to get table and field completion, but startup
and reconnecting may take a longer time. Disable with
--disable-auto-rehash.
-..................................


Variables (--variable-name=value)
and boolean options {FALSE|TRUE} Value (after reading options)
--------------------------------- -----------------------------
auto-rehash TRUE
character-sets-dir (No default value)
column-type-info FALSE
comments FALSE
compress FALSE
debug-check FALSE
debug-info FALSE
database (No default value)
default-character-set latin1
delimiter ;
vertical FALSE
force FALSE
named-commands FALSE
ignore-spaces FALSE
local-infile FALSE
no-beep FALSE
host localhost
html FALSE
xml FALSE
line-numbers TRUE
unbuffered FALSE
column-names FALSE
sigint-ignore FALSE
port 3306
prompt mysql>
quick TRUE
raw FALSE
reconnect FALSE
socket /var/run/mysqld/mysqld.sock
ssl FALSE
ssl-ca (No default value)
ssl-capath (No default value)
ssl-cert (No default value)
ssl-cipher (No default value)
ssl-key (No default value)
ssl-verify-server-cert FALSE
table FALSE
user root
safe-updates FALSE
i-am-a-dummy FALSE
connect_timeout 0
max_allowed_packet 16777216
net_buffer_length 16384
select_limit 1000
max_join_size 1000000
secure-auth FALSE
show-warnings FALSE

Thanks

 

[Jarod]

I've downloaded all the files from the temp-dir and they are filled with the same output mysql gives......So maybe there is a problem:

View attachment 51984



Thanks

Hello,

- 1st step : Export.php ( create files on tmp dir)
- 2d stp : Import.php (import and dump (with tmp files) to xenforo database)

the mine done 1 hour ago :

rw-r--r-- 1 root root 53598 23 juil. 19:59 attachment_tmp
-rw-r--r-- 1 root root 4016 23 juil. 19:59 avatar_temp
-rw-r--r-- 1 root root 238078547 23 juil. 19:55 xf_conversation_master.txt
-rw-r--r-- 1 root root 1548977674 23 juil. 19:57 xf_conversation_message.txt
-rw-r--r-- 1 root root 205826026 23 juil. 19:57 xf_conversation_recipient.txt
-rw-r--r-- 1 root root 143983516 23 juil. 19:57 xf_conversation_user.txt
-rw-r--r-- 1 root root 5825116 23 juil. 19:59 xf_deletion_log.txt
-rw-r--r-- 1 root root 0 23 juil. 19:59 xf_forum_read.txt
-rw-r--r-- 1 root root 3098 23 juil. 19:59 xf_forum.txt
-rw-r--r-- 1 root root 34565212 23 juil. 19:55 xf_ip.txt
-rw-r--r-- 1 root root 65085 23 juil. 19:55 xf_liked_content.txt
-rw-r--r-- 1 root root 139 23 juil. 19:59 xf_link_forum.txt
-rw-r--r-- 1 root root 24775517 23 juil. 19:59 xf_moderator_log.txt
-rw-r--r-- 1 root root 3671 23 juil. 19:59 xf_node.txt
-rw-r--r-- 1 root root 45576 23 juil. 19:55 xf_poll_response.txt
-rw-r--r-- 1 root root 21880 23 juil. 19:55 xf_poll.txt
-rw-r--r-- 1 root root 2333356 23 juil. 19:55 xf_poll_vote.txt
-rw-r--r-- 1 root root 583407029 23 juil. 20:02 xf_post_aa.txt
-rw-r--r-- 1 root root 475893595 23 juil. 20:02 xf_post_ab.txt
-rw-r--r-- 1 root root 536304222 23 juil. 20:02 xf_post_ac.txt
-rw-r--r-- 1 root root 515258483 23 juil. 20:02 xf_post_ad.txt
-rw-r--r-- 1 root root 512221915 23 juil. 20:02 xf_post_ae.txt
-rw-r--r-- 1 root root 509514968 23 juil. 20:02 xf_post_af.txt
-rw-r--r-- 1 root root 540401965 23 juil. 20:02 xf_post_ag.txt
-rw-r--r-- 1 root root 486681246 23 juil. 20:02 xf_post_ah.txt
-rw-r--r-- 1 root root 521825485 23 juil. 20:02 xf_post_ai.txt
-rw-r--r-- 1 root root 543837159 23 juil. 20:02 xf_post_aj.txt
-rw-r--r-- 1 root root 560806469 23 juil. 20:02 xf_post_ak.txt
-rw-r--r-- 1 root root 193322155 23 juil. 20:02 xf_post_al.txt
-rw-r--r-- 1 root root 47879608 23 juil. 19:55 xf_profile_post.txt
-rw-r--r-- 1 root root 0 23 juil. 19:55 xf_report_comment.txt
-rw-r--r-- 1 root root 0 23 juil. 19:55 xf_report.txt
-rw-r--r-- 1 root root 491008 23 juil. 19:59 xf_stats_daily.txt
-rw-r--r-- 1 root root 0 23 juil. 19:55 xf_thread_read.txt
-rw-r--r-- 1 root root 41717861 23 juil. 19:55 xf_thread.txt
-rw-r--r-- 1 root root 43733320 23 juil. 19:55 xf_thread_user_post.txt
-rw-r--r-- 1 root root 30607186 23 juil. 19:55 xf_thread_watch.txt
-rw-r--r-- 1 root root 60996868 23 juil. 19:56 xf_user_authenticate.txt
-rw-r--r-- 1 root root 0 23 juil. 19:55 xf_user_ban.txt
-rw-r--r-- 1 root root 630242 23 juil. 19:55 xf_user_follow.txt
-rw-r--r-- 1 root root 11878 23 juil. 19:55 xf_user_ignored.txt
-rw-r--r-- 1 root root 12444795 23 juil. 19:55 xf_user_option.txt
-rw-r--r-- 1 root root 16914694 23 juil. 19:55 xf_user_privacy.txt
-rw-r--r-- 1 root root 28737311 23 juil. 19:55 xf_user_profile.txt
-rw-r--r-- 1 root root 45747352 23 juil. 19:56 xf_user.txt
-rw-r--r-- 1 root root 0 23 juil. 19:55 xf_user_upgrade_active.txt
-rw-r--r-- 1 root root 0 23 juil. 19:55 xf_user_upgrade_expired.txt
-rw-r--r-- 1 root root 0 23 juil. 19:55 xf_user_upgrade_log.txt
-rw-r--r-- 1 root root 0 23 juil. 19:55 xf_warning_action_trigger.txt
-rw-r--r-- 1 root root 1090446 23 juil. 19:55 xf_warning.txt

 

[Slavik]

I've downloaded all the files from the temp-dir and they are filled with the same output mysql gives......So maybe there is a problem:

Thanks

Can you try updating the mysql (client, common and server) to 5.5.

 

[ehd]

Can you try updating the mysql (client, common and server) to 5.5.

This might be difficult. I will ask for it.

But has anyone successfully run this on mysql 5.0.10 and below?

Thanks

 

[Slavik]

This might be difficult. I will ask for it.

But has anyone successfully run this on mysql 5.0.10 and below?

Thanks

I believe all the people who have used it this far are on 5.5. Having said that I don't think theres anything specific that would stop it, but you never know.

 

[ehd]

That may be the last thing which I or my host could alter to get it running. Using the built-in-converter will keep me hours or even days waiting while converting...

 

[Slavik]

That may be the last thing which I or my host could alter to get it running. Using the built-in-converter will keep me hours or even days waiting while converting...

If thats not an option, look at doing an off-site conversion.

A centos minimal install, percona, apache, php, php-cli php-mysql, development tools.

Should have everything you need there.

 

[ehd]

PHP Version 5.4.4-14+deb7u3
mysql Client API version 5.5.31
pcntl support enabled

Again the same problem:

web1@tmp:~/htdocs$ php Export.php


!...

1 - Posts
2 - Users
3 - Threads
4 - Private Messages
5 - Avatars
6 - Attachments
7 - Forums
8 - Miscellaneous
9 - Everything

Make Selection [1-9]: 1

exporting posts...
posts (198 records in 0.01s)...
post IPs (198 records in 0.01s)...
likes (198 records in 0.01s)...
reported posts (198 records in 0.01s)...
reported post comments (198 records in 0.01s)...
reported profile posts (396 records in 0.01s)...
reported profile post comments (396 records in 0.01s)...
reported private messages (594 records in 0.01s)...
reported private message comments (594 records in 0.01s)...
Total time for posts: 0.08s

 

[Slavik]

The only thing I could suggest is the importer is issuing a command which your mysql install doesn't like.

Can you try logging in via shell and running one of the mysql commands to see if it spits out an error.

 

[ehd]

May you please give me a little hint which command I should run exactly from the shell...?

 

[Slavik]

Just chose one and give it a try, eg

mysql -h localhost sourcedbname -uUser -pPass -N -q -e "SET NAMES binary;SELECT SQL_NO_CACHE pmtext.pmtextid AS conversation_id, REPLACE(REPLACE(REPLACE(REPLACE(pmtext.title, \'&lt;\', \'<\'), \'&gt;\', \'>\'), \'&quot;\', \'\\"\'), \'&amp;\', \'&\'), fromuserid AS user_id, fromusername AS username, dateline AS start_date, 0 AS open_invite, 1 AS conversation_open, 0 AS reply_count, GREATEST(2, (SELECT COUNT(*) FROM pm WHERE pm.pmtextid = pmtext.pmtextid)) AS recipient_count, pmtextid AS first_message_id, dateline AS last_message_date, pmtextid AS last_message_id, fromuserid AS last_message_user_id, fromusername AS last_message_username FROM pmtext ORDER BY pmtext.pmtextid" > xf_conversation_master.txt;

 

[ehd]

-bash: Syntaxfehler beim unerwarteten Wort `)'

Syntax-error at unexpected word `)'

That comes back.

 

[Slavik]

try removing the replace commands.

REPLACE(REPLACE(REPLACE(REPLACE(pmtext.title, \'&lt;\', \'<\'), \'&gt;\', \'>\'), \'&quot;\', \'\\"\'), \'&amp;\', \'&\'),

 

[ehd]

Great. This worked like a charm an created a 20mb-file with valid content!

 

[Slavik]

So your mysql doesn't like the replace commands being run.

Alright, leave it with me for now.

 

[ehd]

Thanks in advance!

 

[Alpha1]

Is this compatible with XF 1.2 and post edit history?

 

[Slavik]

Is this compatible with XF 1.2 and post edit history?

Not yet.

 

[Jake Bunce]

FYI, I am reviewing this importer with XF 1.2 right now. It might work as is, but I am going through all of the columns with a new 1.2.0 gold install to confirm everything is correct.