Task 13793607

Name	hadam3p_saf_7bjx_2001_1_007571910_1
Workunit	7750040
Created	18 Dec 2011, 10:43:26 UTC
Sent	18 Dec 2011, 11:00:20 UTC
Report deadline	29 Nov 2012, 16:20:20 UTC
Received	28 Apr 2012, 11:15:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1082219
Run time	3 days 7 hours 40 min 2 sec
CPU time	2 days 16 hours 21 min 33 sec
Validate state	Invalid
Credit	1,496.58
Device peak FLOPS	2.61 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4812, selfPID=3984, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4260, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3896, selfPID=4500, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4088, selfPID=3756, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:31:23 (1036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:21:33 (4388): No heartbeat from core client for 30 sec - exiting 20:21:34 (4388): No heartbeat from core client for 30 sec - exiting 20:21:35 (4388): No heartbeat from core client for 30 sec - exiting 20:21:36 (4388): No heartbeat from core client for 30 sec - exiting 20:21:37 (4388): No heartbeat from core client for 30 sec - exiting 20:21:38 (4388): No heartbeat from core client for 30 sec - exiting 20:21:39 (4388): No heartbeat from core client for 30 sec - exiting 20:21:40 (4388): No heartbeat from core client for 30 sec - exiting 20:21:41 (4388): No heartbeat from core client for 30 sec - exiting 20:21:42 (4388): No heartbeat from core client for 30 sec - exiting 20:21:43 (4388): No heartbeat from core client for 30 sec - exiting 20:21:44 (4388): No heartbeat from core client for 30 sec - exiting 20:21:45 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:21:46 (4388): No heartbeat from core client for 30 sec - exiting 20:21:47 (4388): No heartbeat from core client for 30 sec - exiting 20:21:48 (4388): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3200, selfPID=4060, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:59:42 (3040): No heartbeat from core client for 30 sec - exiting 21:59:43 (3040): No heartbeat from core client for 30 sec - exiting 21:59:44 (3040): No heartbeat from core client for 30 sec - exiting 21:59:45 (3040): No heartbeat from core client for 30 sec - exiting 21:59:46 (3040): No heartbeat from core client for 30 sec - exiting 21:59:47 (3040): No heartbeat from core client for 30 sec - exiting 21:59:48 (3040): No heartbeat from core client for 30 sec - exiting 21:59:49 (3040): No heartbeat from core client for 30 sec - exiting 21:59:50 (3040): No heartbeat from core client for 30 sec - exiting 21:59:51 (3040): No heartbeat from core client for 30 sec - exiting 21:59:52 (3040): No heartbeat from core client for 30 sec - exiting 21:59:53 (3040): No heartbeat from core client for 30 sec - exiting 21:59:54 (3040): No heartbeat from core client for 30 sec - exiting 21:59:55 (3040): No heartbeat from core client for 30 sec - exiting 21:59:56 (3040): No heartbeat from core client for 30 sec - exiting 21:59:57 (3040): No heartbeat from core client for 30 sec - exiting 21:59:58 (3040): No heartbeat from core client for 30 sec - exiting 21:59:59 (3040): No heartbeat from core client for 30 sec - exiting 22:00:00 (3040): No heartbeat from core client for 30 sec - exiting 22:00:01 (3040): No heartbeat from core client for 30 sec - exiting 22:00:02 (3040): No heartbeat from core client for 30 sec - exiting 22:00:04 (3040): No heartbeat from core client for 30 sec - exiting 22:00:05 (3040): No heartbeat from core client for 30 sec - exiting 22:00:06 (3040): No heartbeat from core client for 30 sec - exiting 22:00:07 (3040): No heartbeat from core client for 30 sec - exiting 22:00:08 (3040): No heartbeat from core client for 30 sec - exiting 22:00:09 (3040): No heartbeat from core client for 30 sec - exiting 22:00:10 (3040): No heartbeat from core client for 30 sec - exiting 22:00:11 (3040): No heartbeat from core client for 30 sec - exiting 22:00:12 (3040): No heartbeat from core client for 30 sec - exiting 22:00:13 (3040): No heartbeat from core client for 30 sec - exiting 22:00:14 (3040): No heartbeat from core client for 30 sec - exiting 22:00:15 (3040): No heartbeat from core client for 30 sec - exiting 22:00:16 (3040): No heartbeat from core client for 30 sec - exiting 22:00:17 (3040): No heartbeat from core client for 30 sec - exiting 22:00:18 (3040): No heartbeat from core client for 30 sec - exiting 22:00:19 (3040): No heartbeat from core client for 30 sec - exiting 22:00:20 (3040): No heartbeat from core client for 30 sec - exiting 22:00:21 (3040): No heartbeat from core client for 30 sec - exiting 22:00:22 (3040): No heartbeat from core client for 30 sec - exiting 22:00:23 (3040): No heartbeat from core client for 30 sec - exiting 22:00:24 (3040): No heartbeat from core client for 30 sec - exiting 22:00:25 (3040): No heartbeat from core client for 30 sec - exiting 22:00:26 (3040): No heartbeat from core client for 30 sec - exiting 22:00:27 (3040): No heartbeat from core client for 30 sec - exiting 22:00:28 (3040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:00 (4084): No heartbeat from core client for 30 sec - exiting 19:29:01 (4084): No heartbeat from core client for 30 sec - exiting 19:29:02 (4084): No heartbeat from core client for 30 sec - exiting 19:29:03 (4084): No heartbeat from core client for 30 sec - exiting 19:29:04 (4084): No heartbeat from core client for 30 sec - exiting 19:29:05 (4084): No heartbeat from core client for 30 sec - exiting 19:29:06 (4084): No heartbeat from core client for 30 sec - exiting 19:29:07 (4084): No heartbeat from core client for 30 sec - exiting 19:29:08 (4084): No heartbeat from core client for 30 sec - exiting 19:29:09 (4084): No heartbeat from core client for 30 sec - exiting 19:29:10 (4084): No heartbeat from core client for 30 sec - exiting 19:29:11 (4084): No heartbeat from core client for 30 sec - exiting 19:29:12 (4084): No heartbeat from core client for 30 sec - exiting 19:29:13 (4084): No heartbeat from core client for 30 sec - exiting 19:29:14 (4084): No heartbeat from core client for 30 sec - exiting 19:29:15 (4084): No heartbeat from core client for 30 sec - exiting 19:29:16 (4084): No heartbeat from core client for 30 sec - exiting 19:29:17 (4084): No heartbeat from core client for 30 sec - exiting 19:29:18 (4084): No heartbeat from core client for 30 sec - exiting 19:29:19 (4084): No heartbeat from core client for 30 sec - exiting 19:29:20 (4084): No heartbeat from core client for 30 sec - exiting 19:29:21 (4084): No heartbeat from core client for 30 sec - exiting 19:29:22 (4084): No heartbeat from core client for 30 sec - exiting 19:29:23 (4084): No heartbeat from core client for 30 sec - exiting 19:29:24 (4084): No heartbeat from core client for 30 sec - exiting 19:29:25 (4084): No heartbeat from core client for 30 sec - exiting 19:29:26 (4084): No heartbeat from core client for 30 sec - exiting 19:29:27 (4084): No heartbeat from core client for 30 sec - exiting 19:29:28 (4084): No heartbeat from core client for 30 sec - exiting 19:29:29 (4084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1640, selfPID=5008, iMonCtr=1 Model crash detected, will try to restart... 23:46:44 (4552): No heartbeat from core client for 30 sec - exiting 23:46:45 (4552): No heartbeat from core client for 30 sec - exiting 23:46:46 (4552): No heartbeat from core client for 30 sec - exiting 23:46:47 (4552): No heartbeat from core client for 30 sec - exiting 23:46:48 (4552): No heartbeat from core client for 30 sec - exiting 23:46:49 (4552): No heartbeat from core client for 30 sec - exiting 23:46:50 (4552): No heartbeat from core client for 30 sec - exiting 23:46:51 (4552): No heartbeat from core client for 30 sec - exiting 23:46:52 (4552): No heartbeat from core client for 30 sec - exiting 23:46:53 (4552): No heartbeat from core client for 30 sec - exiting 23:46:54 (4552): No heartbeat from core client for 30 sec - exiting 23:46:55 (4552): No heartbeat from core client for 30 sec - exiting 23:46:56 (4552): No heartbeat from core client for 30 sec - exiting 23:46:57 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:25:00 (328): No heartbeat from core client for 30 sec - exiting 23:25:01 (328): No heartbeat from core client for 30 sec - exiting 23:25:02 (328): No heartbeat from core client for 30 sec - exiting 23:25:03 (328): No heartbeat from core client for 30 sec - exiting 23:25:04 (328): No heartbeat from core client for 30 sec - exiting 23:25:05 (328): No heartbeat from core client for 30 sec - exiting 23:25:06 (328): No heartbeat from core client for 30 sec - exiting 23:25:07 (328): No heartbeat from core client for 30 sec - exiting 23:25:08 (328): No heartbeat from core client for 30 sec - exiting 23:25:09 (328): No heartbeat from core client for 30 sec - exiting 23:25:10 (328): No heartbeat from core client for 30 sec - exiting 23:25:11 (328): No heartbeat from core client for 30 sec - exiting 23:25:12 (328): No heartbeat from core client for 30 sec - exiting 23:25:13 (328): No heartbeat from core client for 30 sec - exiting 23:25:14 (328): No heartbeat from core client for 30 sec - exiting 23:25:15 (328): No heartbeat from core client for 30 sec - exiting 23:25:16 (328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:25:17 (328): No heartbeat from core client for 30 sec - exiting 23:25:18 (328): No heartbeat from core client for 30 sec - exiting 23:25:19 (328): No heartbeat from core client for 30 sec - exiting 23:25:20 (328): No heartbeat from core client for 30 sec - exiting 10:54:36 (3352): No heartbeat from core client for 30 sec - exiting 10:54:37 (3352): No heartbeat from core client for 30 sec - exiting 10:54:38 (3352): No heartbeat from core client for 30 sec - exiting 10:54:39 (3352): No heartbeat from core client for 30 sec - exiting 10:54:40 (3352): No heartbeat from core client for 30 sec - exiting 10:54:41 (3352): No heartbeat from core client for 30 sec - exiting 10:54:42 (3352): No heartbeat from core client for 30 sec - exiting 10:54:43 (3352): No heartbeat from core client for 30 sec - exiting 10:54:44 (3352): No heartbeat from core client for 30 sec - exiting 10:54:45 (3352): No heartbeat from core client for 30 sec - exiting 10:54:46 (3352): No heartbeat from core client for 30 sec - exiting 10:54:47 (3352): No heartbeat from core client for 30 sec - exiting 10:54:48 (3352): No heartbeat from core client for 30 sec - exiting 10:54:49 (3352): No heartbeat from core client for 30 sec - exiting 10:54:50 (3352): No heartbeat from core client for 30 sec - exiting 10:54:51 (3352): No heartbeat from core client for 30 sec - exiting 10:54:52 (3352): No heartbeat from core client for 30 sec - exiting 10:54:53 (3352): No heartbeat from core client for 30 sec - exiting 10:54:54 (3352): No heartbeat from core client for 30 sec - exiting 10:54:55 (3352): No heartbeat from core client for 30 sec - exiting 10:54:56 (3352): No heartbeat from core client for 30 sec - exiting 10:54:57 (3352): No heartbeat from core client for 30 sec - exiting 10:54:58 (3352): No heartbeat from core client for 30 sec - exiting 10:54:59 (3352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3448, selfPID=3040, iMonCtr=1 Model crash detected, will try to restart... 19:55:23 (1760): No heartbeat from core client for 30 sec - exiting 19:55:24 (1760): No heartbeat from core client for 30 sec - exiting 19:55:25 (1760): No heartbeat from core client for 30 sec - exiting 19:55:26 (1760): No heartbeat from core client for 30 sec - exiting 19:55:27 (1760): No heartbeat from core client for 30 sec - exiting 19:55:28 (1760): No heartbeat from core client for 30 sec - exiting 19:55:29 (1760): No heartbeat from core client for 30 sec - exiting 19:55:30 (1760): No heartbeat from core client for 30 sec - exiting 19:55:31 (1760): No heartbeat from core client for 30 sec - exiting 19:55:32 (1760): No heartbeat from core client for 30 sec - exiting 19:55:33 (1760): No heartbeat from core client for 30 sec - exiting 19:55:34 (1760): No heartbeat from core client for 30 sec - exiting 19:55:35 (1760): No heartbeat from core client for 30 sec - exiting 19:55:36 (1760): No heartbeat from core client for 30 sec - exiting 19:55:37 (1760): No heartbeat from core client for 30 sec - exiting 19:55:38 (1760): No heartbeat from core client for 30 sec - exiting 19:55:39 (1760): No heartbeat from core client for 30 sec - exiting 19:55:40 (1760): No heartbeat from core client for 30 sec - exiting 19:55:41 (1760): No heartbeat from core client for 30 sec - exiting 19:55:42 (1760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:59:41 (1792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4276, selfPID=4356, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2244, selfPID=3708, iMonCtr=1 Model crash detected, will try to restart... 21:04:37 (4024): No heartbeat from core client for 30 sec - exiting 21:04:38 (4024): No heartbeat from core client for 30 sec - exiting 21:04:39 (4024): No heartbeat from core client for 30 sec - exiting 21:04:40 (4024): No heartbeat from core client for 30 sec - exiting 21:04:41 (4024): No heartbeat from core client for 30 sec - exiting 21:04:42 (4024): No heartbeat from core client for 30 sec - exiting 21:04:43 (4024): No heartbeat from core client for 30 sec - exiting 21:04:44 (4024): No heartbeat from core client for 30 sec - exiting 21:04:45 (4024): No heartbeat from core client for 30 sec - exiting 21:04:46 (4024): No heartbeat from core client for 30 sec - exiting 21:04:47 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:48 (4024): No heartbeat from core client for 30 sec - exiting 21:04:49 (4024): No heartbeat from core client for 30 sec - exiting 21:04:50 (4024): No heartbeat from core client for 30 sec - exiting 21:04:51 (4024): No heartbeat from core client for 30 sec - exiting 21:04:52 (4024): No heartbeat from core client for 30 sec - exiting 21:04:53 (4024): No heartbeat from core client for 30 sec - exiting 21:04:54 (4024): No heartbeat from core client for 30 sec - exiting 21:04:55 (4024): No heartbeat from core client for 30 sec - exiting 21:04:56 (4024): No heartbeat from core client for 30 sec - exiting 21:04:57 (4024): No heartbeat from core client for 30 sec - exiting 21:04:58 (4024): No heartbeat from core client for 30 sec - exiting 21:04:59 (4024): No heartbeat from core client for 30 sec - exiting 21:05:00 (4024): No heartbeat from core client for 30 sec - exiting 21:05:01 (4024): No heartbeat from core client for 30 sec - exiting 21:05:02 (4024): No heartbeat from core client for 30 sec - exiting 21:05:03 (4024): No heartbeat from core client for 30 sec - exiting 21:05:04 (4024): No heartbeat from core client for 30 sec - exiting 21:05:05 (4024): No heartbeat from core client for 30 sec - exiting 21:05:06 (4024): No heartbeat from core client for 30 sec - exiting 21:05:07 (4024): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5084, selfPID=3472, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_7bjx_2001_1_007571910_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7bjx_2001_1_007571910_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7bjx_2001_1_007571910_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7bjx_2001_1_007571910_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Apr 2012 21:10:51	1082219	13793607	hadam3p_saf_7bjx_2001_1_007571910_1	92,256	217,577	2.3584
14 Apr 2012 08:46:21	1082219	13793607	hadam3p_saf_7bjx_2001_1_007571910_1	80,753	191,971	2.3773
14 Apr 2012 08:00:30	1082219	13793607	hadam3p_saf_7bjx_2001_1_007571910_1	80,736	191,513	2.3721
05 Apr 2012 20:47:47	1082219	13793607	hadam3p_saf_7bjx_2001_1_007571910_1	69,216	162,722	2.3509
31 Mar 2012 09:35:44	1082219	13793607	hadam3p_saf_7bjx_2001_1_007571910_1	57,696	135,593	2.3501
25 Mar 2012 10:22:03	1082219	13793607	hadam3p_saf_7bjx_2001_1_007571910_1	46,176	108,979	2.3601
28 Feb 2012 06:59:33	1082219	13793607	hadam3p_saf_7bjx_2001_1_007571910_1	34,656	80,772	2.3307
20 Feb 2012 19:57:10	1082219	13793607	hadam3p_saf_7bjx_2001_1_007571910_1	23,136	53,773	2.3242
14 Feb 2012 22:52:55	1082219	13793607	hadam3p_saf_7bjx_2001_1_007571910_1	11,616	26,891	2.3150