My concern would be attachment pages looking like actual pages -- thus creating thousands of thin-content pages. I agree with you, if Google handles the images correctly. I'm curious if they show in the index.
We allow guest viewing of attachments, and Google's results are similar to my fellow Monkey-site owner above. Only attachments that have actual indexed content appear in search results, otherwise you have to do a Google Image search to see the rest.