All attachments are stored in the file system.
Only the details are stored in the database.
If you delete it from the original post then the file will be removed from the server.
If you're embedding an remote image url then if it is removed from the original location, all embedded links will no longer work.