I was wondering what your backup and recovery solution? Have you tested your recovery? Do you have a script to tar and download to another source? Just interested in some of the less extreme but effective solutions you've tried.
mysqldump -q -f -Q -e -h[HOSTNAME] -u[USERNAME] -p[DBPASSWORD] [DBNAME] | gzip > [BACKUP_PATH]/[DBNAME].1.sql.gz