Results 1 to 6 of 6

Thread: Amazon S3 slot reuse problems

  1. #1

    Default Amazon S3 slot reuse problems

    I have an Amanda configuration for doing daily backups on S3. I have 7 slots defined in my configuration which appeared to work fine for a period of time but have subsequently stopped working. Following is the output from amcheck:

    ==========
    Amanda Tape Server Host Check
    -----------------------------
    Holding disk /dumps: 872525824 KB disk space available, using 767668224 KB
    slot 1: volume 'S3-DailySet1-01' is still active and cannot be overwritten
    slot 2: volume 'S3-DailySet1-02' is still active and cannot be overwritten
    slot 3: volume 'S3-DailySet1-03' is still active and cannot be overwritten
    slot 4: volume 'S3-DailySet1-04' is still active and cannot be overwritten
    slot 5: volume 'S3-DailySet1-05' is still active and cannot be overwritten
    slot 6: volume 'S3-DailySet1-06' is still active and cannot be overwritten
    slot 7: volume 'S3-DailySet1-07' is still active and cannot be overwritten
    Taper scan algorithm did not find an acceptable volume.
    (expecting a new volume)
    ERROR: No acceptable volumes found
    Server check took 5.320 seconds
    ===========


    It appears that I successfully overwrote (reused) slots for awhile, but at some point the state of the slots became inconsistent and it shows them as busy.

    I thought that I was perhaps uploading too much data, but my total is ~1G per day on a 5Mbs channel that averages ~500KB/sec upload speed -- plenty I should think. Also, there do not appear to be any active writers still working with the slots that should cause this problem.

    The was a configuration problem that occurred about 1 week ago resulting from a change in internal domain names and in the name server configuration. This has now been rectified and everything appears to be consistent. I think that is when the problem started.

    At this point I have tried several things to proceed including:

    * Attempting a manual amflush
    * Attempting an amtape reset
    * Attempting a manual amdump
    * Attempting an amtape clean

    Basically, my state for all 7 slots is locked and I cannot seem to find the right knobs to unlock it.

    Specific questions:

    1. How can I manually clear the state on the slots?
    2. Do I have to do something to have data overwrite into those slots? They are marked for reuse already.
    3. How do I get status on the slot itself when using the S3 device?

    Following is my configuration, more or less straight from the Howto S3 pages on the Zmanda Wiki:


    # MODULE: amanda.conf

    # OVERVIEW
    # Working set Amanda configuration file. This file defines the working
    # set specific configuration. The syntax and content is defined by amanda.conf(5).
    # END OVERVIEW

    # HISTORY
    # Created Jun 16, 2010 by sh and tn:
    # END HISTORY

    # : include the common Amanda configuration definitions
    includefile "/etc/amanda/amanda-common.conf"

    # : working set specific values
    labelstr "^S3-DailySet1-[0-9][0-9]*$" # label constraint regex: all tapes must match
    infofile "/var/amanda/DailySet1/curinfo" # database DIRECTORY
    logdir "/var/amanda/DailySet1/log" # log directory
    indexdir "/var/amanda/DailySet1/index" # index directory
    tapelist "/var/amanda/DailySet1/tapelist" # list of used tapes

    # We are using Amazon S3
    tapedev "null:" #

    # device should come from the changer
    device_property "S3_ACCESS_KEY" "MY_ACCESS_KEY"
    device_property "S3_SECRET_KEY" "MY_SECRET_KEY"
    tpchanger "chg-multi"
    changerfile "/etc/amanda/DailySet1/changer.conf"

    # MODULE: amanda.conf

  2. #2

    Default

    What are the values of dumpcycle, runspercycle, tapecycle and runtapes?

    I suspect you haven't got enough tapes. You need enough tapes to have two complete dump cycles and some spares on hand. The spares are good practice, even with virtual tapes and cloud storage. The reason for two complete dump cycles is to keep on hand at least one level 0 dump for each DLE.

  3. #3

    Default

    Thanks very much for the help. This was exactly the problem ... and I should have read the documentation associated with these values. I will say (in my defense) that the documentation surrounding these values is not particularly clear or even easy to find. An introductory piece that describes the operational policy parts of Amanda would be very useful.

    At any rate, thanks for taking the time to respond. I was very helpful.

    Cheers.

  4. #4

    Default

    Hi,

    I've run into the same issue here as well and could do with some advice if possible.

    We have the following values:

    dumpcycle 4 weeks
    runspercycle 20
    tapecycle 25 tapes
    runtapes 1

    We get the same error when running amcheck:

    Holding disk /dumps/amanda: 10100736 KB disk space available, using 9998336 KB
    slot 1: volume 'DailySet1-1' is still active and cannot be overwritten
    slot 2: volume 'DailySet1-2' is still active and cannot be overwritten
    slot 3: volume 'DailySet1-3' is still active and cannot be overwritten
    slot 4: volume 'DailySet1-4' is still active and cannot be overwritten
    slot 5: volume 'DailySet1-5' is still active and cannot be overwritten
    slot 6: volume 'DailySet1-6' is still active and cannot be overwritten
    slot 7: volume 'DailySet1-7' is still active and cannot be overwritten
    slot 8: volume 'DailySet1-8' is still active and cannot be overwritten
    slot 9: volume 'DailySet1-9' is still active and cannot be overwritten
    slot 10: volume 'DailySet1-10' is still active and cannot be overwritten
    Taper scan algorithm did not find an acceptable volume.
    (expecting a new volume)
    ERROR: No acceptable volumes found
    Server check took 4.932 seconds

    Hope you can help? I don't know what to do

    Thanks,

    Bob

  5. #5
    Join Date
    Nov 2005
    Location
    Canada
    Posts
    1,049

    Default

    Your tapecycle is 25, amanda will not overwrite a volume until it write 25 different volumes
    Either add more volumes or reduce tapecycle.

  6. #6

    Default

    Hi,

    Really appreciate the advice. Sorry if it's a stupid question, I'm very new to this!

    I will reduce the cycle to 10 - would it however be best therefore to reduce the other parameters.

    Thanks again,

    Bob

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •