Console Import

[Vincent Gabriel]

Hi,

Looking for some feedback regarding console command import. i've been working with it and so far it works pretty well, anyone has any benchmarks or timing they've done using the importer tool?

For some reason if i uncomment the mysql transactions from the steps it appears to work faster and process the results quicker, maybe just my testing.

I only tested with VBulletin and i have a large database to test with 20M posts 300K users.

I'd also like to start a discussion on command tools for large forums that have ssh access and running on vps/dedicated servers and much rather use command tools than web based.


Thoughts?

Thank You.

 

[Vincent Gabriel]

Did anyone ever try to benchmark or profile the importer? i am still working on trying to make this work for large imports but the only thing that takes forever right now is the threads, i'll try and profile to see what's the most time consuming operation for that but i kinda think it'll be the lookups for the user ids, post ids, thread ids.