There are a few different processes that can create them, likely with add-ons using it as well. By default, mostly avatars and attachments use them. They are normally cleaned up as needed, but a fatal error (such as a memory limit) could prevent that.
You can delete them. (Note that they're probably owned by your web server user or have different permissions, so you may need to be root to remove them.)