Results 1 to 6 of 6

Thread: More Level 1 backups than tapes

  1. #1
    Join Date
    Jul 2012
    Posts
    4

    Question More Level 1 backups than tapes

    Hi all, this is my first post but I have been searching for ages and I can only assume I'm missing the point. Any help greatly appreciated.

    I'm assuming this isn't an issue with my version of Amanda but for reference I'm using 3.3.1 on Ubuntu 10.04. I have multiple DLEs (1x ~130GB,3x 20-50 GB and 1x200MB). Everything looked like it was working fine for the first few days, I saw amanda promoting level 0 backups to spread the load etc. I restored a few files using amrecover, generally very happy with how it was working. I mail the output of 'amadmin DailySet1 export' to myself to aid in recovery as mentioned on the Wiki and yesterday I spotted this:

    Code:
    host: old-thumper
    disk: /boot
    command: 0
    last_level: 1
    consecutive_runs: 9
    full-rate: 25414.285714 -1.000000 -1.000000
    full-comp: -1.000000 -1.000000 -1.000000
    incr-rate: -1.000000 -1.000000 -1.000000
    incr-comp: -1.000000 -1.000000 -1.000000
    stats: 0 177900 177900 7 3827384379680 1 DailySet1-01
    stats: 1 10 10 0 7475303247392 1 DailySet1-03
    history: 1 10 10 1342610192
    history: 1 10 10 1342562448
    history: 1 10 10 1342410000
    history: 1 10 10 1342178576
    history: 1 10 10 1342080272
    history: 1 10 10 1341986320
    history: 1 10 10 1341875360
    history: 1 10 10 1341873952
    history: 1 10 10 1341575680
    history: 0 177900 177900 1341384080
    To me this implies that for the /boot DLE it has done 9 level 1 backups in a row. This is a problem as I only have 7 tapes at present. The relevant bits of my config are shown below, some of the other DLEs have more than four level 1 dumps in a row (which I wouldn't have expected) but I haven't lost any other level 0 dumps yet.

    /etc/amanda/DailySet1/amanda.conf
    Code:
    dumpcycle 1 week 
    runspercycle 5
    tapecycle 7 tapes
    
    flush-threshold-dumped 0
    flush-threshold-scheduled 0
    taperflush 0
    autoflush no
    
    runtapes 1 
    tapedev "tape:/dev/st0" 
    
    maxdumpsize -1
         
    tapetype LTO-5     
    labelstr "^DailySet1-[0-9][0-9]*$" 
    
    
    infofile "/backups/amanda/DailySet1/curinfo" 
    logdir   "/backups/amanda/DailySet1" 
    indexdir "/backups/amanda/DailySet1/index"
    
    
    define tapetype LTO-5 {
        comment "Created by amtapetype"
        length 1480262176 kbytes
        filemark 3689 kbytes
        speed 128876 kps
        blocksize 32 kbytes
    }
    
    
    define dumptype global {
        comment "Global definitions"
        holdingdisk never
    }
    
    define dumptype simple-tar {
        global
        program "GNUTAR"
        comment "Very simple backup"
        compress none
        index
        priority medium
    }
    /etc/amanda/DailySet1/disklist
    Code:
    <snip>
    old-thumper /boot         simple-tar
    <snip>
    /etc/amanda/DailySet1/tapelist
    Code:
    20120718 DailySet1-03 reuse BLOCKSIZE:32
    20120717 DailySet1-02 reuse BLOCKSIZE:32
    20120716 DailySet1-01 reuse BLOCKSIZE:32
    20120713 DailySet1-00 reuse BLOCKSIZE:32
    20120712 DailySet1-06 reuse BLOCKSIZE:32
    20120711 DailySet1-05 reuse BLOCKSIZE:32
    20120710 DailySet1-04 reuse BLOCKSIZE:32
    I am trying to get complete backups once a week (dumpcycle 1 week) and I run amdump every weekday evening (runspercycle 5). I thought having 7 tapes (tapecycle 7 tapes) would allow it to write the next level 0 dump without overwriting the previous level 0 dump.

    Am I missing something really obvious here?

    Rob

  2. #2
    Join Date
    Nov 2005
    Location
    Canada
    Posts
    1,049

    Default

    Post the latest log.<datestamp>.0 and the amdump.1 log files so that I can look at waht is going on.

  3. #3
    Join Date
    Jul 2012
    Posts
    4

    Default

    Thanks for the quick response, I have included the log before last as I forced level 0 for them all last night.

    /backups/amanda/DailySet1/log.20120718.0
    Code:
    INFO amdump amdump pid 3309
    INFO driver driver pid 3311
    INFO planner planner pid 3310
    START planner date 20120718
    DISK planner old-thumper /
    DISK planner old-thumper /boot
    START driver date 20120718
    DISK planner old-thumper /export/home
    STATS driver hostname old-thumper
    DISK planner old-thumper /export/etsi
    DISK planner old-thumper /export/home1
    DISK planner old-thumper /export/home4
    WARNING planner Last full dump of old-thumper:/ on tape DailySet1-04 overwritten in 1 run.
    STATS driver startup time 0.016
    WARNING planner Last full dump of old-thumper:/boot on tape DailySet1-01 overwritten in 5 runs.
    WARNING planner Last full dump of old-thumper:/export/home on tape DailySet1-03 overwritten on this run.
    WARNING planner Last full dump of old-thumper:/export/etsi on tape DailySet1-04 overwritten in 1 run.
    WARNING planner Last full dump of old-thumper:/export/home1 on tape DailySet1-04 overwritten in 1 run.
    INFO dumper dumper pid 3316
    INFO dumper dumper pid 3318
    INFO dumper dumper pid 3315
    INFO dumper dumper pid 3317
    INFO taper taper pid 3314
    INFO taper Slot 1 with label DailySet1-03 is usable
    FINISH planner date 20120718 time 78.328
    INFO planner pid-done 3310
    INFO dumper gzip pid 3541
    INFO dumper pid-done 3541
    SUCCESS dumper old-thumper /boot 20120718 1 [sec 0.050 kb 10 kps 199.9 orig-kb 10]
    START taper datestamp 20120718 label DailySet1-03 tape 1
    PART taper DailySet1-03 1 old-thumper /boot 20120718 1/-1 1 [sec 4.901006 bytes 10240 kps 2.040397]
    DONE taper old-thumper /boot 20120718 1 1 [sec 11.000000 bytes 10240 kps 0.909091 orig-kb 10]
    STATS driver estimate old-thumper /boot 20120718 1 [sec 0 nkb 42 ckb 64 kps 1024]
    INFO dumper gzip pid 3583
    INFO dumper pid-done 3583
    SUCCESS dumper old-thumper /export/etsi 20120718 1 [sec 0.069 kb 360 kps 5205.8 orig-kb 360]
    PART taper DailySet1-03 2 old-thumper /export/etsi 20120718 1/-1 1 [sec 2.025323 bytes 368640 kps 177.749462]
    DONE taper old-thumper /export/etsi 20120718 1 1 [sec 2.000000 bytes 368640 kps 180.000000 orig-kb 360]
    STATS driver estimate old-thumper /export/etsi 20120718 1 [sec 0 nkb 392 ckb 416 kps 1024]
    INFO dumper gzip pid 3627
    PART taper DailySet1-03 3 old-thumper /export/home1 20120718 1/-1 1 [sec 2.284935 bytes 4546560 kps 1943.162236]
    INFO dumper pid-done 3627
    SUCCESS dumper old-thumper /export/home1 20120718 1 [sec 5.322 kb 4440 kps 834.2 orig-kb 4440]
    DONE taper old-thumper /export/home1 20120718 1 1 [sec 2.000000 bytes 4546560 kps 2220.000000 orig-kb 4440]
    STATS driver estimate old-thumper /export/home1 20120718 1 [sec 5 nkb 4472 ckb 4480 kps 888]
    INFO dumper gzip pid 3671
    INFO dumper pid-done 3671
    SUCCESS dumper old-thumper /export/home4 20120718 1 [sec 0.593 kb 7350 kps 12385.7 orig-kb 7350]
    PART taper DailySet1-03 4 old-thumper /export/home4 20120718 1/-1 1 [sec 2.578842 bytes 7526400 kps 2850.116557]
    DONE taper old-thumper /export/home4 20120718 1 1 [sec 3.000000 bytes 7526400 kps 2450.000000 orig-kb 7350]
    STATS driver estimate old-thumper /export/home4 20120718 1 [sec 1 nkb 7382 ckb 7392 kps 6329]
    INFO dumper gzip pid 3713
    PART taper DailySet1-03 5 old-thumper /export/home 20120718 1/-1 1 [sec 52.970701 bytes 1132615680 kps 20880.788498]
    INFO dumper pid-done 3713
    SUCCESS dumper old-thumper /export/home 20120718 1 [sec 56.227 kb 1106070 kps 19671.5 orig-kb 1106070]
    DONE taper old-thumper /export/home 20120718 1 1 [sec 53.000000 bytes 1132615680 kps 20869.245283 orig-kb 1106070]
    STATS driver estimate old-thumper /export/home 20120718 1 [sec 44 nkb 1106102 ckb 1106112 kps 25078]
    INFO dumper gzip pid 3839
    PART taper DailySet1-03 6 old-thumper / 20120718 1/-1 1 [sec 28.329544 bytes 1344450560 kps 46345.257405]
    INFO dumper pid-done 3839
    STRANGE dumper old-thumper / 1 [sec 31.087 kb 1312940 kps 42233.8 orig-kb 1312940]
      sendbackup: start [old-thumper:/ level 1]
      sendbackup: info BACKUP=/bin/tar
      sendbackup: info RECOVER_CMD=/bin/tar -xpGf - ...
      sendbackup: info end
      ? /bin/tar: ./var/spool/postfix/active/3F5231401D6: Warning: Cannot stat: No such file or directory
      ? /bin/tar: ./var/spool/postfix/active/4247B1402B3: Warning: Cannot stat: No such file or directory
      ? /bin/tar: ./var/spool/postfix/active/4DF5D14021E: Warning: Cannot stat: No such file or directory
      | Total bytes written: 1344450560 (1.3GiB, 50MiB/s)
      sendbackup: size 1312940
      sendbackup: end
    DONE taper old-thumper / 20120718 1 1 [sec 28.000000 bytes 1344450560 kps 46890.714286 orig-kb 1312940]
    STATS driver estimate old-thumper / 20120718 1 [sec 27 nkb 1311652 ckb 1311680 kps 47947]
    INFO dumper pid-done 3315
    INFO dumper pid-done 3316
    INFO dumper pid-done 3317
    INFO dumper pid-done 3318
    INFO taper tape DailySet1-03 kb 2431170 fm 6 [OK]
    INFO taper pid-done 3314
    FINISH driver date 20120718 time 237.848
    INFO driver pid-done 3311
    I'll attach the amdump to my next post.

  4. #4
    Join Date
    Jul 2012
    Posts
    4

    Default

    /backups/amanda/DailySet1/amdump.2

    Interesting bits?
    Code:
    SETTING UP FOR ESTIMATES...
    planner: time 0.004: setting up estimates for old-thumper:/
    driver: started dumper0 pid 3315
    driver: send-cmd time 0.014 to dumper0: START 20120718
    driver: started dumper1 pid 3316
    driver: send-cmd time 0.015 to dumper1: START 20120718
    setup_estimate: old-thumper:/: command 0, options: none    last_level 1 next_level0 15985 level_days 5    getting estimates 0 (-3) 1 (-3) -1 (-3)
    planner: time 0.006: setting up estimates for old-thumper:/boot
    driver: started dumper2 pid 3317
    driver: send-cmd time 0.015 to dumper2: START 20120718
    driver: started dumper3 pid 3318
    driver: send-cmd time 0.016 to dumper3: START 20120718
    driver: send-cmd time 0.016 to taper: START-TAPER worker0 20120718
    driver: start time 0.016 inparallel 4 bandwidth 8000 diskspace 0  dir OBSOLETE datestamp 20120718 driver: drain-ends tapeq FIRST big-dumpers sssS
    driver: state time 0.016 free kps: 8000 space: 0 taper: idle idle-dumpers: 4 qlen tapeq: 0 runq: 0 roomq: 0 wakeup: 0 driver-idle: not-idle
    driver: interface-state time 0.016 if default: free 8000
    driver: hdisk-state time 0.016
    setup_estimate: old-thumper:/boot: command 0, options: none    last_level 1 next_level0 44282896 level_days 8    getting estimates 0 (-3) 1 (-3) -1 (-3)
    planner: time 0.008: setting up estimates for old-thumper:/export/home
    setup_estimate: old-thumper:/export/home: command 0, options: none    last_level 1 next_level0 3774 level_days 6    getting estimates 0 (-3) 1 (-3) -1 (-3)
    planner: time 0.010: setting up estimates for old-thumper:/export/etsi
    setup_estimate: old-thumper:/export/etsi: command 0, options: none    last_level 1 next_level0 15985 level_days 5    getting estimates 0 (-3) 1 (-3) -1 (-3)
    planner: time 0.013: setting up estimates for old-thumper:/export/home1
    setup_estimate: old-thumper:/export/home1: command 0, options: none    last_level 1 next_level0 15985 level_days 5    getting estimates 0 (-3) 1 (-3) -1 (-3)
    planner: time 0.018: setting up estimates for old-thumper:/export/home4
    setup_estimate: old-thumper:/export/home4: command 0, options: none    last_level 1 next_level0 6409 level_days 7    getting estimates 0 (-3) 1 (-3) -1 (-3)
    planner: time 0.020: setting up estimates took 0.015 secs
    Code:
    ANALYZING ESTIMATES...
    pondering old-thumper:/export/home4... next_level0 6409 last_level 1 (not due for a full dump, picking an incr level)
       pick: size 7350 level 1 days 7 (thresh 6010698K, 1 days)
      curr level 1 nsize 7350 csize 7350 total size 18513 total_lev0 0 balanced-lev0size 6010698
    pondering old-thumper:/export/home1... next_level0 15985 last_level 1 (not due for a full dump, picking an incr level)
       pick: size 4440 level 1 days 5 (thresh 6733724K, 1 days)
      curr level 1 nsize 4440 csize 4440 total size 26674 total_lev0 0 balanced-lev0size 12744422
    pondering old-thumper:/export/etsi... next_level0 15985 last_level 1 (not due for a full dump, picking an incr level)
       pick: size 360 level 1 days 5 (thresh 526160K, 1 days)
      curr level 1 nsize 360 csize 360 total size 30755 total_lev0 0 balanced-lev0size 13270582
    pondering old-thumper:/export/home... next_level0 3774 last_level 1 (not due for a full dump, picking an incr level)
       pick: size 1106070 level 1 days 6 (thresh 39550420K, 1 days)
      curr level 1 nsize 1106070 csize 1106070 total size 1140546 total_lev0 0 balanced-lev0size 52821002
    pondering old-thumper:/boot... next_level0 44282896 last_level 1 (not due for a full dump, picking an incr level)
       pick: size 10 level 1 days 8 (thresh 35580K, 1 days)
      curr level 1 nsize 10 csize 10 total size 1144277 total_lev0 0 balanced-lev0size 52856582
    pondering old-thumper:/... next_level0 15985 last_level 1 (not due for a full dump, picking an incr level)
       pick: size 1311620 level 1 days 5 (thresh 1520852K, 1 days)
      curr level 1 nsize 1311620 csize 1311620 total size 2459618 total_lev0 0 balanced-lev0size 54377434
    INITIAL SCHEDULE (size 2459618):
      old-thumper / pri 1 lev 1 nsize 1311620 csize 1311620
      old-thumper /export/home pri 1 lev 1 nsize 1106070 csize 1106070
      old-thumper /export/home4 pri 1 lev 1 nsize 7350 csize 7350
      old-thumper /export/home1 pri 1 lev 1 nsize 4440 csize 4440
      old-thumper /export/etsi pri 1 lev 1 nsize 360 csize 360
      old-thumper /boot pri 1 lev 1 nsize 10 csize 10
    
    DELAYING DUMPS IF NEEDED, total_size 2459618, tape length 1480262176 mark 3689
      delay: Total size now 2459618.
    
    PROMOTING DUMPS IF NEEDED, total_lev0 0, balanced_size 54377434...
    planner: time 78.327: analysis took 0.001 secs
    
    GENERATING SCHEDULE:
    --------
    DUMP old-thumper ffffffff9efefbffffffffff1f / 20120718 1 1 2056:4:17:10:33:20 1311620 1311620 27 47947 "Skipping: strategy NOINC can't be dumped in degraded mode"
    DUMP old-thumper ffffffff9efefbffffffffff1f /export/home 20120718 1 1 2022:11:11:17:14:8 1106070 1106070 44 25078 "Skipping: strategy NOINC can't be dumped in degraded mode"
    DUMP old-thumper ffffffff9efefbffffffffff1f /export/home4 20120718 1 1 2030:1:29:2:28:0 7350 7350 1 6329 "Skipping: strategy NOINC can't be dumped in degraded mode"
    DUMP old-thumper ffffffff9efefbffffffffff1f /export/home1 20120718 1 1 2056:4:17:10:33:20 4440 4440 5 888 "Skipping: strategy NOINC can't be dumped in degraded mode"
    DUMP old-thumper ffffffff9efefbffffffffff1f /export/etsi 20120718 1 1 2056:4:17:10:33:20 360 360 0 1024 "Skipping: strategy NOINC can't be dumped in degraded mode"
    DUMP old-thumper ffffffff9efefbffffffffff1f /boot 20120718 1 1 123254:12:25:7:41:2 10 10 0 1024 "Skipping: strategy NOINC can't be dumped in degraded mode"
    Attached Files Attached Files
    Last edited by techno74; July 20th, 2012 at 05:32 AM. Reason: include some sections inline

  5. #5
    Join Date
    Nov 2005
    Location
    Canada
    Posts
    1,049

    Default

    It is a bug with the use of 'usetimestamps no' in amanda.conf

    The attached patch fix it, you must force a full of each DLE.

    As a workaround, set it to yes and force a full.
    Attached Files Attached Files

  6. #6
    Join Date
    Jul 2012
    Posts
    4

    Default

    Hi martineau, Thank You!

    If you need me to test the patch, let me know and I will try. Otherwise I am happy to just set usetimestamp to yes (and force a full).

    Regards,
    Rob

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •