The built in importer requires certain other content to be imported before users and threads can be, such as user groups, custom user fields, etc.
You can prune the content you don't want in the source database before importing, or from XF after importing.