I've been struggling with an I'm guessing a Amanda problem for a couple of weeks. It works great with Amazon S3 storage but not our cloud providers' S3 storage. I have confirmed that using S3 browser I can connect and upload files to our cloud providers' S3 storage OK. Just not able to upload anything with Amanda.

I'm trying to configure a Amanda to use our cloud providers S3 storage. It is not Amazon. I'm using the latest Amanda server 3.3.6, CentOS 6.5 64bit.

I can not get it to backup to the our cloud S3 ATMOS storage at all. When I go to label the vTapes I get an HTTP 413 response.

This an example of what happens;

-bash-4.1$ amlabel OraclePOCS3 OraclePOCS307 slot 7
Reading label...
Found an empty tape.
Writing label 'OraclePOCS307'...
Error writing label: While writing amanda header: Unknown S3 error (None) (HTTP 413)

-bash-4.1$ amlabel OraclePOCS3 OraclePOCS307 slot 7
Reading label...
Error reading volume label: Empty header file
Not writing label.


The first time I execute the command there is no slot 7 tape header file on the S3 storage. The next time it errors because it Amanda created a tape header file on the S3 storage on the previous run, but they are of zero size. I turned on the the verbose logging in the configuration file it gather more information;


amlabel.log snippet;

Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: About to connect() to xxxx.xxxxx.com port 8443 (#0)
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Trying 1.1.1.1...
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: connected
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Connected to xxxx.xxxx.com (1.1.1.1) port 8443 (#0)
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: CAfile: /etc/pki/tls/certs/ca-bundle.crt
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: CApath: none
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: SSL connection using SSL_RSA_WITH_RC4_128_MD5
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Server certificate:
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: subject: CN=xxxx.xxxx.com,OU="Member, VeriSign Trust Network",OU=Authenticated by VeriSign,OU=Terms of use at ww.verisign.co.uk/rpa (c)05,O=xxxx xxxx xxxxx Ltd,L=Corsham,ST=Wiltshire,C=GB
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: start date: Mar 26 00:00:00 2013 GMT
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: expire date: Mar 26 23:59:59 2017 GMT
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: common name: xxxx.xxxxx.com
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: issuer: CN=VeriSign Class 3 Secure Server CA - G3,OU=Terms of use at ttps://www.verisign.com/rpa (c)10,OU=VeriSign Trust Network,O="VeriSign, Inc.",C=US
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr Out: PUT /OraclePOCS3-backups/OraclePOCS3%2Fslot-07special-tapestart HTTP/1.1^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr Out: Host: xxxx.xxxx.com:8443^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr Out: Accept: */*^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr Out: Authorization: AWS xxxxxx^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr Out: Content-MD5: VMQfDobc4UV8SRJT5i/4Dg==^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr Out: Content-Length: 46^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr Out: Date: Thu, 25 Sep 2014 10:36:34 GMT^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr Out: Content-Length: 46^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr Out: Expect: 100-continue^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr Out: ^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr In: HTTP/1.1 413 Request Entity Too Large^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr In: Date: Thu, 25 Sep 2014 10:36:35 GMT^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Time Offset (remote - local) :-3597
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr In: Server: Apache^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr In: Connection: close^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr In: Content-Type: text/html; charset=iso-8859-1^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Hdr In: ^M
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Data In: <?xml version="1.0" encoding="UTF-8"?><Error><Code>InternalError</Code><Message>We encountered an internal error. Please try again.</Message></Error>
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Closing connection #0
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: PUT h-ttps://xxxx.xxxxx.com:8443/OraclePOCS3-backups/OraclePOCS3%2Fslot-07special-tapestart failed with 413/None
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Device s3:OraclePOCS3-backups/OraclePOCS3/slot-07 error = 'While writing amanda header: Unknown S3 error (None) (HTTP 413)'
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: Device s3:OraclePOCS3-backups/OraclePOCS3/slot-07 setting status flag(s): DEVICE_STATUS_DEVICE_ERROR, and DEVICE_STATUS_VOLUME_ERROR
Thu Sep 25 12:36:32 2014: thd-0x1700200: amlabel: pid 1232 finish time Thu Sep 25 12:36:32 2014


amanda.conf;
org "OraclePOCS3"
infofile "/var/backups/OraclePOCS3/state/curinfo"
logdir "/var/backups/OraclePOCS3/state/log"
indexdir "/var/backups/OraclePOCS3/state/index"
dumpuser "amandabackup"

#labelstr "OraclePOCS3[0-9][0-9]"
#autolabel "OraclePOCS3-%%%" EMPTY VOLUME_ERROR
autolabel "OraclePOCS3-$3s" any
tapecycle 4
dumpcycle 7 days
runspercycle 672
amrecover_changer "changer"


device_property "S3_ACCESS_KEY" "xxxx"
device_property "S3_SECRET_KEY" "xxxx"
device_property "REUSE-CONNECTION" "NO"

device_property "VERBOSE" "YES"

device_property "S3_HOST" "xxxx.xxxx.com:8443"
#device_property "PROXY" "xxxx.xxxx.local:8443"
#device_property "S3_HOST" "1.1.1.1:8443"

device_property "S3_SSL" "YES"
tpchanger "chg-multi:s3:OraclePOCS3-backups/OraclePOCS3/slot-{01,02,03,04,05,06,07,08,09,10}"

changerfile "s3-statefile"

tapetype S3
define tapetype S3 {
comment "S3 Bucket"
length 10240 gigabytes # Bucket size 10TB
}



define dumptype simple-gnutar-local {
exclude "./snap*"
auth "bsdtcp"
compress none
program "GNUTAR"
}

holdingdisk hd1 {
directory "/var/backups/OraclePOCS3/holding"
chunksize 1 mbyte
}