1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Console Import

Discussion in 'XenForo Development Discussions' started by Vincent Gabriel, Feb 2, 2016.

  1. Vincent Gabriel

    Vincent Gabriel Active Member

    Hi,

    Looking for some feedback regarding console command import. i've been working with it and so far it works pretty well, anyone has any benchmarks or timing they've done using the importer tool?

    For some reason if i uncomment the mysql transactions from the steps it appears to work faster and process the results quicker, maybe just my testing.

    I only tested with VBulletin and i have a large database to test with 20M posts 300K users.

    I'd also like to start a discussion on command tools for large forums that have ssh access and running on vps/dedicated servers and much rather use command tools than web based.


    Thoughts?

    Thank You.
     

    Attached Files:

  2. Vincent Gabriel

    Vincent Gabriel Active Member

    Did anyone ever try to benchmark or profile the importer? i am still working on trying to make this work for large imports but the only thing that takes forever right now is the threads, i'll try and profile to see what's the most time consuming operation for that but i kinda think it'll be the lookups for the user ids, post ids, thread ids.
     

Share This Page