PDA

View Full Version : ZWC client unstable when log_level < 5



dlebo
December 22nd, 2010, 12:36 PM
0000: 41 70 70 6c 69 63 61 74 Applicat
0008: 69 6f 6e 20 46 61 69 6c ion Fail
0010: 75 72 65 20 20 5a 57 43 ure ZWC
0018: 53 65 72 76 69 63 65 2e Service.
0020: 65 78 65 20 30 2e 30 2e exe 0.0.
0028: 30 2e 30 20 69 6e 20 43 0.0 in C
0030: 6f 6d 6d 6f 6e 2e 64 6c ommon.dl
0038: 6c 20 30 2e 30 2e 30 2e l 0.0.0.
0040: 30 20 61 74 20 6f 66 66 0 at off
0048: 73 65 74 20 30 30 30 30 set 0000
0050: 35 30 63 31 50c1

I'm running amanda server 3.1.3 on a debian server. I have 4 windows machines I'm backing up nightly via cron. The win XP pro SP3 machines have windows client 3.1.3 installed. When I first set this up I would see the ZWC service exit about 50% of the time. I found if I set the log level of the client to 5 the stability was much better. I ran for a week or so and started having backups fails on multiple clients.

FAILURE DUMP SUMMARY:
planner: ERROR Request to 192.168.0.152 failed: Connection timed out

When I looked at the event log of the xp machines i see the above exit message of the zwc service. I then noticed that the log files were starting to be over written on the client machines so I archived them and deleted them. After this backups started to run successfully again. There seems to be an issue with the stability of the ZWC service when the log files wrap-around past log file count and / or when the log level is not set to 5.

Is this a known issue?

-Doug

harsha
December 22nd, 2010, 10:43 PM
To debug the ZWCService crash issue, we will need a crash dump file. Pl. follow the following steps and sned us the logs.

1. Run setup-debug-env.bat (in bin folder of ZWC install dir). It will enable Dr.Watson debugger which will create a memory crash dump file when ZWCService crashes.
2. Let the debug level be 2.
3. Rerun backup and if ZWCService crashes, collect and send us the logs.
Note: After collecting the logs, Dr. Watson debugger will be disabled.

dlebo
December 30th, 2010, 02:57 PM
Hi,

I set the log level to 2 and enabled Dr Watson on 3 of the windows XP pro SP3 clients. The first day of running backups went without an issue. Tonight ( day 2 ) 2 of the 3 machines had the zwc service crash during the backup. Please find the dr watson log for one of the hosts attached. The log from the second host is 600KB compressed so I'm unable to attach it. Please let me know if there is a ftp site where I can place it.

Thanks for your help.

-Doug

paddy
December 30th, 2010, 03:05 PM
Are you running Windows Client 3.1.2?

Can you use yousendit.com to send Dr. Watson logs?

Paddy

dlebo
December 30th, 2010, 03:24 PM
Hi,

I'm running version ZWC-Community-3.1.3-32bit on all 4 of my windows xp machines.

I will upload the larger log to yousendit.com.

The second log has crashes from other applications in it. I separated the zwc service crash out and have attached it. Please let me know if you need anything else.

-Doug

dlebo
December 30th, 2010, 03:48 PM
https://www.yousendit.com/download/RlRybUpld0FlM1JFQlE9PQ

-Doug

harsha
January 2nd, 2011, 08:59 PM
drwatson.txt file is not of much use. We will need a memory dump generated by Dr.Watson i.e. user.dmp file.

Pl. follow the steps I have mentioned in my previous reply and collect the ZWC logs by running "zwc-support.bat" in bin folder of zmanda installation directory. (while collecting ZWC logs, we collect memory dump file as well.).

-Harsha

dlebo
January 7th, 2011, 04:39 PM
Hi,

I reran the batch file setup-debug-env.bat on all 3 machines which I had done before. Yesterday one machine crashed and tonight another machine crashed. I packaged up the crash info using the batch file you said to use in your last post.

There are two crashes on yousendit

ebc_bk1-zwc-logs-20110107174146.cab ( Crashed 1/6/2011 )
http://www.yousendit.com/download/RlRyZm1kOW5OQnp2Wmc9PQ


ebcaud1b-zwc-logs-20110107200037.cab ( Crashed 1/7/2011 )
http://www.yousendit.com/download/RlRyZm1UVEhuSlJFQlE9PQ

Let me know if something I have done is incorrect.

-Doug

harsha
January 10th, 2011, 01:54 AM
Thanks Doug for the logs.

We got the crash dump files in it. And we are currently investigating it.

Will get back to you ASAP.

-Harsha

harsha
January 13th, 2011, 03:27 AM
Hi Doug,

We could figure out the crash location. But to test the fix, we need to reproduce the crash locally which is not happening.
Can you pl. send us the server logs ? We want to see the backupset configuration to help reproduce the issue.

thanks
-Harsha

dlebo
January 14th, 2011, 04:23 PM
Hi Harsha,

The logs from /etc/amanda/DailySet2 are attached.

I looked in /var/log/amanda and I do not see anything from the dates in question.
I also included the config file.

Note that I had to rename the extension to .zip inorder to get the file to upload. The file is a .tar.gz file aka gzip -dc <name> | tar xf - to unpack

If you need anything else let me know.

Thanks for your help.

-Doug