vBulletin Big Board Importer [vBulletin 3 + vBulletin 4] [Paid] 1.5.0

[Brent W]

This was using 1.2 XenForo and 1.2 BB importer.

 

[Jake Bunce]

This was using 1.2 XenForo and 1.2 BB importer.

Then debugging is required. Look at xf_user.user_group_id in the XF database and examine the values in that column. Something might have gone wrong with the import.

 

[Jake Bunce]

I get this error when trying to rebuild user caches after import:
Server Error
Mysqli statement execute error : Incorrect integer value: '' for column 'user_group_id' at row 1

1. Zend_Db_Statement_Mysqli->_execute() in Zend/Db/Statement.php at line 297
2. Zend_Db_Statement->execute() in Zend/Db/Adapter/Abstract.php at line 479
3. Zend_Db_Adapter_Abstract->query() in Zend/Db/Adapter/Abstract.php at line 574
4. Zend_Db_Adapter_Abstract->insert() in XenForo/Model/Permission.php at line 1416
5. XenForo_Model_Permission->findOrCreatePermissionCombination() in XenForo/Model/Permission.php at line 1377
6. XenForo_Model_Permission->findOrCreatePermissionCombinationFromUser() in XenForo/Model/Permission.php at line 1246
7. XenForo_Model_Permission->updateUserPermissionCombination() in XenForo/DataWriter/User.php at line 962
8. XenForo_DataWriter_User->rebuildPermissionCombinationId() in XenForo/Deferred/User.php at line 37
9. XenForo_Deferred_User->execute() in XenForo/Model/Deferred.php at line 197
10. XenForo_Model_Deferred->runDeferred() in XenForo/Model/Deferred.php at line 320
11. XenForo_Model_Deferred->_runInternal() in XenForo/Model/Deferred.php at line 273
12. XenForo_Model_Deferred->run() in XenForo/ControllerAdmin/Tools.php at line 147
13. XenForo_ControllerAdmin_Tools->actionRunDeferred() in XenForo/FrontController.php at line 337
14. XenForo_FrontController->dispatch() in XenForo/FrontController.php at line 134
15. XenForo_FrontController->run() in /home/nginx/domains/religiousforums.com/public/admin.php at line 13

It could also be an invalid list of group ids in xf_user.secondary_group_ids. During that rebuild the list is exploded and used to insert records into xf_user_group_relation.

 

[Walter]

Any timeframe for fixing the issue with Xenforo 1.4 (column alignment)?
(and at least write a short comment on the first page that this addon currently is not compatible with Xenforo 1.4 before more are hurt)

 

[CreationNation]

I'm waiting to purchase the script once you finish the eval/tweak Jake, so that I can use 1.4 fresh.

Do you generally update here once all complete with new changes to the script?

Thanks.

 

[Jake Bunce]

Any timeframe for fixing the issue with Xenforo 1.4 (column alignment)?
(and at least write a short comment on the first page that this addon currently is not compatible with Xenforo 1.4 before more are hurt)

I'm waiting to purchase the script once you finish the eval/tweak Jake, so that I can use 1.4 fresh.

Do you generally update here once all complete with new changes to the script?

Thanks.

I just finished updating the column orders in the Export script. I sent it to Slavik who will handle posting the update for you to get.

The only outstanding issue with using this importer for XF 1.4 is the xf_ip table. It was actually XF 1.3 which added support for IPv6, and this importer will need the various IP sections rewritten to conform to the new format. If you don't care about importing your IP logs then it doesn't matter. I have commented out this line in the Import.php script so it doesn't import the IPs in the meantime:

//importTable('xf_ip');

When I get time to do this... my inclination will probably be to import IPs using the old format and then copy some code from the XF 1.3 upgrade script to make the appropriate conversions after-the-fact.

 

[Slavik]

Slavik updated vBulletin Big Board Importer [vBulletin 3 + vBulletin 4] with a new update entry:

1.4 Update

Updated column orders to work with XenForo 1.4.

(Note, will no longer work on previous versions of XenForo).

Read the rest of this update entry...

 

[HD-Sam]

Any suggestions to speed up the cache rebuild process after import? or is the following typical?

Background: There are 1M users, 30M Posts
I'm currently rebuilding user cache.
It's processing ~5,100 users per minute.

I tried a thread rebuild on a previous import... that took most of the day.

 

[Jake Bunce]

Any suggestions to speed up the cache rebuild process after import? or is the following typical?

Background: There are 1M users, 30M Posts
I'm currently rebuilding user cache.
It's processing ~5,100 users per minute.

I tried a thread rebuild on a previous import... that took most of the day.

You shouldn't have to rebuild the thread info.

But the user info must be rebuilt. I don't have any way to speed it up. You might consider running that rebuild concurrently before the Import script has finished. When the Import says "Cleaning Up..." you should be able to login to the Admin CP and start running the user rebuild.

 

[Superfluous]

I'm still getting an error when trying to Export Avatars and Attachments (options 5 and 6) using the table prefix 'vb_' on the newest version of the Big Board Import script. Every other option works fine.

 

[Jake Bunce]

I'm still getting an error when trying to Export Avatars and Attachments (options 5 and 6) using the table prefix 'vb_' on the newest version of the Big Board Import script. Every other option works fine.

You found a bug.

This bug will only affect non-empty source prefixes. To fix it, add the code in red (3 pieces):

	public function avatars ()
	{

		$globalStart = microtime(true);		
		
		echo "\r\nperforming avatar diff...";

		$avatarModel = XenForo_Model::create('XenForo_Model_Avatar');
		
		static $types = array(
			1 => 'GIF',
			2 => 'JPEG',
			3 => 'PNG'
		);
		
		static $_sizes = array(
				'l' => 192,
				'm' => 96,
				's' => 48
		);
		
		static $imageQuality = 60;
		
		$fileName = '' . self::$dataDir . 'avatar_temp';
		
		
		$currentTime = time();

		while (
				
				
				//	WHERE user.userid BETWEEN ' . intval($start) . ' AND ' . intval($start + 999) . ' AND (customavatar.dateline IS NOT NULL OR customprofilepic.dateline IS NOT NULL)
		
			$users = $this->db->fetchAll('
				SELECT user.userid, IF(customavatar.dateline, customavatar.dateline, customprofilepic.dateline) AS avatar_date, IF(customavatar.dateline, customavatar.filedata, customprofilepic.filedata) AS image, user.avatarrevision AS avatarrevision, user.profilepicrevision AS profilepicrevision
					FROM ' . $this->sourceDb . '.' . self::$tablePrefix . 'user AS user
						LEFT JOIN ' . $this->sourceDb . '.' . self::$tablePrefix . 'customavatar AS customavatar ON (customavatar.userid = user.userid)
						LEFT JOIN ' . $this->sourceDb . '.' . self::$tablePrefix . 'customprofilepic AS customprofilepic ON (customprofilepic.userid = user.userid)
					WHERE 
						(customavatar.dateline IS NOT NULL OR customprofilepic.dateline IS NOT NULL)
					
					ORDER BY user.userid
				')
		)
		{

			echo "\r\n         " . number_format(count($users)) . " users with new avatars\r\n";
	
			foreach ($users as $user)
			{

 

[Slavik]

Slavik updated vBulletin Big Board Importer [vBulletin 3 + vBulletin 4] with a new update entry:

Avatars Bugfix

Fixed avatar import to work with table prefixes.

Read the rest of this update entry...

 

[Superfluous]

Slavik updated vBulletin Big Board Importer [vBulletin 3 + vBulletin 4] with a new update entry:

Avatars Bugfix



Read the rest of this update entry...

Don't know if you got it already - but there was also the same unknown column bug 'fileedata.filedata' and 'attachment.attachmentid' on the the attachments Export. I just applied the same fix ("$tablePrefix . 'attachment as attachment" etc) and it worked fine.

 

[Slavik]

Don't know if you got it already - but there was also the same unknown column bug 'fileedata.filedata' and 'attachment.attachmentid' on the the attachments Export. I just applied the same fix ("$tablePrefix . 'attachment as attachment" etc) and it worked fine.

Thanks

 

[Slavik]

Don't know if you got it already - but there was also the same unknown column bug 'fileedata.filedata' and 'attachment.attachmentid' on the the attachments Export. I just applied the same fix ("$tablePrefix . 'attachment as attachment" etc) and it worked fine.

Just looking now, ive spotted the filedata one, but the attachmentid looks correct? Can you confirm it was that?

 

[Superfluous]

Just looking now, ive spotted the filedata one, but the attachmentid looks correct? Can you confirm it was that?

Sorry it was 'updating attachment view count'

 

[Slavik]

Yea i found that one

Thanks

 

[Slavik]

Slavik updated vBulletin Big Board Importer [vBulletin 3 + vBulletin 4] with a new update entry:

Attachment Fix

Updated attachment export to work with table prefixes.

Read the rest of this update entry...

 

[HD-Sam]

I ran an import using the latest big board importer version 1.4.1 with XF 1.4.2; however, the homepage is not listing any forums. I rebuilt the Forum cache, and no luck. The xf_node table however does have a list of all the forums.

When I click on Search Forums, it only has two forums listed in the 'Search in Forums' field.

Any suggestions?

 

[Jake Bunce]

I ran an import using the latest big board importer version 1.4.1 with XF 1.4.2; however, the homepage is not listing any forums. I rebuilt the Forum cache, and no luck. The xf_node table however does have a list of all the forums.

When I click on Search Forums, it only has two forums listed in the 'Search in Forums' field.

Any suggestions?

It's probably your permissions. Make sure your user has permission to view those forums (check the permissions for your groups). And be sure to rebuild the user cache which will recalculate permissions after the import.