1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

CLI Import External Data 0.0.1

cli import tool

  1. Vincent Gabriel

    Vincent Gabriel Active Member

    Vincent Gabriel submitted a new resource:

    CLI Import External Data - cli import tool

    Read more about this resource...
     
  2. RoldanLT

    RoldanLT Well-Known Member

  3. Slavik

    Slavik XenForo Moderator Staff Member

  4. Vincent Gabriel

    Vincent Gabriel Active Member

    That's correct. It mimics the default one but allows to run trough the command line. It'll allow to maybe increase the batch size of each step to run it faster on larger boards with vps or dedicated servers.

    I actually bought the big board importer and this won't work nearly as fast
     
  5. adamsmasher

    adamsmasher Active Member

    Has anyone tried increasing the batch size? I'd think not using HTTP would speed things up a little bit depending on internet connection. I'm also curious if there's a way to pause, change the the limit, and resume.
     
  6. Vincent Gabriel

    Vincent Gabriel Active Member

    You can set the batch size when you run the command and yes you can and should increase batch size if you have a powerful enough server with enough resources.

    you can also run it in the background. just append &
     
  7. adamsmasher

    adamsmasher Active Member

    I can't say if it was faster without doing another import and comparing times. It's mostly users and attachments that are super slow.
     
  8. Vincent Gabriel

    Vincent Gabriel Active Member

    Normally on larger boards the threads and posts take the longest. for us with 20Million posts that was the issue.
     

Share This Page