The contact system uses the same email method as the rest of the site. If you're using an SMTP server, unless it rejects the email when you try to send it (which would be logged in the control panel), it's responsible for sending any error messages to your bounce email account. If it's not doing that, that's an issue with the SMTP server itself unfortunately.
You may wish to try using a local MTA.