OK. That's what I have been doing, but I thought I remembered once being able to select an attachment that had been previously uploaded. It's possible that I'm confusing XF attachments with the system used by another forum platform though.
I don't know how much work it would be, but it would be user friendly if the Attach Files button on the message editor frame allowed you to select a previously uploaded file.