Fixed Error in Import

[skotos]

I'm experimenting with an import from an existing vB4+Blog site, and after it went through the first few thousand users, the import crashed:

XF\Db\Exception: MySQL query error [1366]: Incorrect string value: '\xF0\x9F\x92\x97 [...' for column 'signature' at row 1 in src/XF/Db/AbstractStatement.php at line 212

1. XF\Db\AbstractStatement->getException() insrc/XF/Db/Mysqli/Statement.php at line 196
2. XF\Db\Mysqli\Statement->getException() insrc/XF/Db/Mysqli/Statement.php at line 77
3. XF\Db\Mysqli\Statement->execute() in src/XF/Db/AbstractAdapter.phpat line 79
4. XF\Db\AbstractAdapter->query() in src/XF/Db/AbstractAdapter.php at line 160
5. XF\Db\AbstractAdapter->insert() insrc/XF/Import/Data/EntityEmulator.php at line 320
6. XF\Import\Data\EntityEmulator->insert() in src/XF/Import/Data/User.phpat line 200
7. XF\Import\Data\User->write() in src/XF/Import/Data/AbstractData.phpat line 126
8. XF\Import\Data\AbstractData->save() in src/XF/Import/Helper.php at line107
9. XF\Import\Helper->importUser() insrc/XF/Import/Importer/AbstractCoreImporter.php at line 107
10. XF\Import\Importer\AbstractCoreImporter->importUser() insrc/addons/XFI/Import/Importer/vBulletin.php at line 1015
11. XFI\Import\Importer\vBulletin->stepUsers() in src/XF/Import/Runner.phpat line 160
12. XF\Import\Runner->runStep() in src/XF/Import/Runner.php at line 74
13. XF\Import\Runner->run() in src/XF/Admin/Controller/Import.php at line232
14. XF\Admin\Controller\Import->actionRun() in src/XF/Mvc/Dispatcher.phpat line 249
15. XF\Mvc\Dispatcher->dispatchClass() in src/XF/Mvc/Dispatcher.php at line 88
16. XF\Mvc\Dispatcher->dispatchLoop() in src/XF/Mvc/Dispatcher.php at line 41
17. XF\Mvc\Dispatcher->run() in src/XF/App.php at line 1931
18. XF\App->run() in src/XF.php at line 329
19. XF::runApp() in admin.php at line 13

Any insight or fixes for this? Thanks.

 

[Paul B]

The string \xF0\x9F\x92\x97 is an emoji.

Have you converted to utf8mb4 and enabled fullUnicode in config.php?

https://xenforo.com/xf2-docs/manual/unicode/

Try doing that and running the import again.

If it still fails then it could be a bug in the importer.

 

[Chris D]

Could you also please confirm which XenForo version you're using and which version of the XenForo Importers add-on you're using?

 

[skotos]

They're both newly donwloaded: XF 2.0.10 and importer 1.2 I believe.

 

[skotos]

Per @Brogan's suggestion, I added `$config['fullUnicode'] = true;` and then I ran the cmd.php update and it seems to be importing again ...

(Thanks.)

 

[Paul B]

I have moved the thread to the bugs forum so the check can be added.

 

[Mike]

I think this can happen if there was an emoji encoded in an HTML entity, which we then decoded. If the string is valid UTF-8 already, then this would bypass the stripping of extended UTF-8 when it wasn't supported. I've accounted for this in the next XFI release.