Results 1 to 5 of 5

Thread: RAW Backup fails with innodb --file-per-table

  1. #1

    Default RAW Backup fails with innodb --file-per-table

    Hi All,

    I'm using zmanda remote to perform LVM based raw backups of a mysql 5.0 server. So far, it appears that the actual LVM snapshot is working, as is the database detection. However, I'm using innodb's file-per-table setting. Zmanda looks like it is still only backing up /db01/mysql/data/ibdata1 & 2, whereas it should be pulling the files contained in /db01/mysql/data/dash_production/

    I end up with a zero byte backup file as a result. Below is a piece of the output relevant to this issue.

    Thoughts?


    dashdb1:backup:INFO: innodb-data=/db01/mysql/data/ibdata1;/db01/mysql/data/ibdata2;
    dashdb1:backup:INFO: innodb-logs=/db01/mysql/data//ib_logfile*
    dashdb1:backup:INFO: raw-databases-snapshot=mysql dash_production
    dashdb1:backup:INFO: PHASE END: Creating snapshot based backup
    dashdb1:backup:INFO: PHASE START: Calculating backup size & checksums
    dashdb1:backup:INFO: next-binlog=mysql-bin.000016
    dashdb1:backup:INFO: backup-size=0.00 MB
    dashdb1:backup:INFO: PHASE END: Calculating backup size & checksums
    dashdb1:backup:INFO: read-locks-time=00:00:06
    dashdb1:backup:INFO: flush-logs-time=00:00:00
    dashdb1:backup:INFO: backup-time=00:01:14
    dashdb1:backup:INFO: backup-status=Backup succeeded
    dashdb1:backup:INFO: Backup succeeded
    dashdb1:backup:INFO: PHASE START: Running post backup plugin
    dashdb1:backup:INFO: Executing post-backup-plugin
    dashdb1:backup:INFO: PHASE END: Running post backup plugin
    dashdb1:backup:INFO: PHASE START: Mailing backup report
    dashdb1:backup:INFO: mailing file /tmp/VLThPxO8WT
    dashdb1:backup:INFO: mail command is cat "/tmp/VLThPxO8WT"|mail -s "[ZRM for MySQL Report] backup-set dashdb1" root@localhost
    dashdb1:backup:INFO: PHASE END: Mailing backup report
    dashdb1:backup:INFO: PHASE START: Cleanup
    dashdb1:backup:INFO: PHASE END: Clean

  2. #2
    Join Date
    Oct 2006
    Posts
    199

    Default

    Could you please send up the verbose logs please?

    --kkg

  3. #3
    Join Date
    Oct 2006
    Posts
    199

    Default

    Quote Originally Posted by kkg View Post
    Could you please send up the verbose logs please?

    --kkg
    Also please do send us which version of ZRM you are using.

    --kkg

  4. #4

    Default Verbose log output and version

    I'm running zmanda 2.1. Here's the full output of the verbose log for a run against this server.

    I'm also noticing it does not unmount and remove my snapshot lv. Is this something I need to take care of in the post plugin?

    Code:
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: START OF BACKUP
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: PHASE START: Initialization
    Thu Jan  8 18:38:40 2009: dashdb1:backup:WARNING: The lvm-snapshot option is deprecated. Use snapshot-size instead
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: Mail address: root@localhost is ok
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: since backup-type is quick, the compress option will be ignored
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: ZRM Temporary configuration file = /etc/mysql-zrm/dashdb1/tmpBVuoh.conf
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: {
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  verbose=1
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  retention-policy=10D
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  synchronous-checksum=-1
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  all-databases=1
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  password=******
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  backup-mode=raw
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  snapshot-plugin=/usr/share/mysql-zrm/plugins/lvm-snapshot.pl
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  compress-plugin=/bin/gzip
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  backup-type=quick
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  user=root
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  copy-plugin=/usr/share/mysql-zrm/plugins/ssh-copy.pl
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  quiet=0
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  backup-level=0
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  replication=0
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  lvm-snapshot=50G
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  mailto=root@localhost
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  ssh-user=root
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  remote-mysql-binpath=/usr/local/mysql/bin
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  host=db1
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  snapshot-size=50G
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  compress=/bin/gzip
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: }
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: Getting mysql variables
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: mysqladmin --user="root" --password="*****" --host="db1" variables
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: datadir is /db01/mysql/data/
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: mysql_version is 5.0.67-log
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: InnoDB data file are /db01/mysql/data/ibdata1 /db01/mysql/data/ibdata2
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: InnoDB log dir is /db01/mysql/data/
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: backup set being used is dashdb1
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: backup-set=dashdb1
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: backup-date=20090108183840
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: mysql-server-os=Linux/Unix
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: backup-type=quick
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: host=db1
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: backup-date-epoch=1231439920
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: retention-policy=10D
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: mysql-zrm-version=ZRM for MySQL Community Edition - version 2.1
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: mysql-version=5.0.67-log
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: backup-directory=/var/lib/mysql-zrm/dashdb1/20090108183840
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: backup-level=0
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: backup-mode=raw
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: PHASE END: Initialization
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: PHASE START: Running pre backup plugin
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: Executing pre-backup-plugin
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: PHASE END: Running pre backup plugin
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: PHASE START: Flushing logs
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: Flushing the logs 
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: mysqladmin --user="root" --password="*****" --host="db1" flush-logs
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: Getting master logname using command mysql --user="root" --password="*****" --host="db1" -e "show master status"
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: PHASE END: Flushing logs
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: Getting list of Databases
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: mysql --user="root" --password="*****" --host="db1" -e "show databases;"
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: PHASE START: Creating snapshot based backup
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: innodb on lvm = 0
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO: getting device details using command /usr/share/mysql-zrm/plugins/lvm-snapshot.pl --action get-vm-device-details --directory /db01/mysql/data/ --sname zrmAC6Qo5hhJg --host db1 2>/tmp/tWNexc7nvF
    Thu Jan  8 18:38:41 2009: dashdb1:backup:INFO: getting device details using command /usr/share/mysql-zrm/plugins/lvm-snapshot.pl --action get-vm-device-details --directory /db01/mysql/data --sname zrmTUvWWUjN4x --host db1 2>/tmp/tWNexc7nvF
    Thu Jan  8 18:38:41 2009: dashdb1:backup:INFO: getting device details using command /usr/share/mysql-zrm/plugins/lvm-snapshot.pl --action get-vm-device-details --directory /db01/mysql/data --sname zrmnapBTRbh4K --host db1 2>/tmp/tWNexc7nvF
    Thu Jan  8 18:38:42 2009: dashdb1:backup:INFO: getting device details using command /usr/share/mysql-zrm/plugins/lvm-snapshot.pl --action get-vm-device-details --directory "/db01/mysql/data//dash_production" --sname zrmVJyPTVnV7a --host db1 2>/tmp/tWNexc7nvF
    Thu Jan  8 18:38:43 2009: dashdb1:backup:INFO: getting device details using command /usr/share/mysql-zrm/plugins/lvm-snapshot.pl --action get-vm-device-details --directory "/db01/mysql/data//mysql" --sname zrmny6WnaMVh1 --host db1 2>/tmp/tWNexc7nvF
    Thu Jan  8 18:38:43 2009: dashdb1:backup:INFO: Locking tables and creating snapshot
    Thu Jan  8 18:38:43 2009: dashdb1:backup:INFO: mysql --user="root" --password="*****" --host="db1" -e "flush tables with read lock; flush logs; show master status;system (/usr/share/mysql-zrm/plugins/lvm-snapshot.pl --action create-snapshot --dev /dev/vg00/lv00 --size 50G --sname zrmAC6Qo5hhJg --directory /var/lib/mysql-zrm/dashdb1/20090108183840/ZRM_MOUNTS/zrmAC6Qo5hhJg --host db1 >/tmp/zrmAC6Qo5hhJg.log 2>&1 ); unlock tables;"
    Thu Jan  8 18:39:26 2009: dashdb1:backup:INFO: File     Position        Binlog_Do_DB    Binlog_Ignore_DB
    mysql-bin.000025        98
    Thu Jan  8 18:39:26 2009: dashdb1:backup:INFO: Output of command: 'Locking tables and creating snapshot' is {
      Logical volume "zrmAC6Qo5hhJg" created
    }
    Thu Jan  8 18:39:26 2009: dashdb1:backup:INFO: Mounting snapshot
    Thu Jan  8 18:39:26 2009: dashdb1:backup:INFO: /usr/share/mysql-zrm/plugins/lvm-snapshot.pl --action mount --dev /dev/vg00/zrmAC6Qo5hhJg --directory /var/lib/mysql-zrm/dashdb1/20090108183840/ZRM_MOUNTS/zrmAC6Qo5hhJg --fstype ext3 --host db1
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: innodb-data=/db01/mysql/data/ibdata1;/db01/mysql/data/ibdata2;
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: innodb-logs=/db01/mysql/data//ib_logfile*
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: raw-databases-snapshot=mysql dash_production 
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: PHASE END: Creating snapshot based backup
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: PHASE START: Calculating backup size & checksums 
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: next-binlog=mysql-bin.000025
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: last-backup=/var/lib/mysql-zrm/dashdb1/20090106221720
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: backup-size=0.00 MB
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: PHASE END: Calculating backup size & checksums 
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: read-locks-time=00:00:43
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: flush-logs-time=00:00:00
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: backup-time=00:00:48
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: backup-status=Backup succeeded
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: Backup succeeded
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: PHASE START: Running post backup plugin
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: Executing post-backup-plugin
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: PHASE END: Running post backup plugin
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: PHASE START: Mailing backup report
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: mailing file /tmp/XfRTnCuAYA
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: mail command is cat "/tmp/XfRTnCuAYA"|mail -s "[ZRM for MySQL Report] backup-set dashdb1" root@localhost
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: PHASE END: Mailing backup report
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: PHASE START: Cleanup
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: PHASE END: Cleanup
    Thu Jan  8 18:39:28 2009: dashdb1:backup:INFO: END OF BACKUP

  5. #5
    Join Date
    Oct 2005
    Posts
    1,559

    Default

    Quote Originally Posted by matthew_swain View Post
    I'm running zmanda 2.1. Here's the full output of the verbose log for a run against this server.

    I'm also noticing it does not unmount and remove my snapshot lv. Is this something I need to take care of in the post plugin?

    Code:
    Thu Jan  8 18:38:40 2009: dashdb1:backup:INFO:  backup-type=quick
    "backup-type" field in mysql-zrm.conf is set up for "quick" snapshots. In this mode, the snapshots are treated as backup. You can convert them into regular backups or delete them using [url=http://mysqlbackup.zmanda.com/index.php/Mysql-zrm-manage-backup]mysql-zrm-manage-backup[/url] command.

    Paddy

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •