Task 16659236

Name	hadam3p_anz_radc_2012_1_008743054_2
Workunit	8889032
Created	2 Jun 2014, 8:35:14 UTC
Sent	2 Jun 2014, 8:35:17 UTC
Report deadline	15 May 2015, 13:55:17 UTC
Received	15 Jun 2014, 19:37:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1322841
Run time	3 days 20 hours 10 min 44 sec
CPU time	3 days 18 hours 4 min 10 sec
Validate state	Invalid
Credit	1,503.36
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.3.11</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11056, selfPID=11056, iMonCtr=2 11:13:39 (2348): No heartbeat from core client for 30 sec - exiting 11:13:40 (2348): No heartbeat from core client for 30 sec - exiting 11:13:41 (2348): No heartbeat from core client for 30 sec - exiting 11:13:42 (2348): No heartbeat from core client for 30 sec - exiting 11:13:44 (2348): No heartbeat from core client for 30 sec - exiting 11:13:45 (2348): No heartbeat from core client for 30 sec - exiting 11:13:46 (2348): No heartbeat from core client for 30 sec - exiting 11:13:47 (2348): No heartbeat from core client for 30 sec - exiting 11:13:48 (2348): No heartbeat from core client for 30 sec - exiting 11:13:49 (2348): No heartbeat from core client for 30 sec - exiting 11:13:50 (2348): No heartbeat from core client for 30 sec - exiting 11:13:51 (2348): No heartbeat from core client for 30 sec - exiting 11:13:52 (2348): No heartbeat from core client for 30 sec - exiting 11:13:53 (2348): No heartbeat from core client for 30 sec - exiting 11:13:54 (2348): No heartbeat from core client for 30 sec - exiting 11:13:56 (2348): No heartbeat from core client for 30 sec - exiting 11:13:57 (2348): No heartbeat from core client for 30 sec - exiting 11:13:58 (2348): No heartbeat from core client for 30 sec - exiting 11:13:59 (2348): No heartbeat from core client for 30 sec - exiting 11:14:00 (2348): No heartbeat from core client for 30 sec - exiting 11:14:01 (2348): No heartbeat from core client for 30 sec - exiting 11:14:02 (2348): No heartbeat from core client for 30 sec - exiting 11:14:03 (2348): No heartbeat from core client for 30 sec - exiting 11:14:04 (2348): No heartbeat from core client for 30 sec - exiting 11:14:05 (2348): No heartbeat from core client for 30 sec - exiting 11:14:06 (2348): No heartbeat from core client for 30 sec - exiting 11:14:08 (2348): No heartbeat from core client for 30 sec - exiting 11:14:09 (2348): No heartbeat from core client for 30 sec - exiting 11:14:10 (2348): No heartbeat from core client for 30 sec - exiting 11:14:11 (2348): No heartbeat from core client for 30 sec - exiting 11:14:12 (2348): No heartbeat from core client for 30 sec - exiting 11:14:13 (2348): No heartbeat from core client for 30 sec - exiting 11:14:14 (2348): No heartbeat from core client for 30 sec - exiting 11:14:15 (2348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:52:01 (4824): No heartbeat from core client for 30 sec - exiting 11:52:03 (4824): No heartbeat from core client for 30 sec - exiting 11:52:04 (4824): No heartbeat from core client for 30 sec - exiting 11:52:05 (4824): No heartbeat from core client for 30 sec - exiting 11:52:06 (4824): No heartbeat from core client for 30 sec - exiting 11:52:07 (4824): No heartbeat from core client for 30 sec - exiting 11:52:08 (4824): No heartbeat from core client for 30 sec - exiting 11:52:09 (4824): No heartbeat from core client for 30 sec - exiting 11:52:10 (4824): No heartbeat from core client for 30 sec - exiting 11:52:11 (4824): No heartbeat from core client for 30 sec - exiting 11:52:12 (4824): No heartbeat from core client for 30 sec - exiting 11:52:13 (4824): No heartbeat from core client for 30 sec - exiting 11:52:14 (4824): No heartbeat from core client for 30 sec - exiting 11:52:15 (4824): No heartbeat from core client for 30 sec - exiting 11:52:16 (4824): No heartbeat from core client for 30 sec - exiting 11:52:17 (4824): No heartbeat from core client for 30 sec - exiting 11:52:18 (4824): No heartbeat from core client for 30 sec - exiting 11:52:19 (4824): No heartbeat from core client for 30 sec - exiting 11:52:20 (4824): No heartbeat from core client for 30 sec - exiting 11:52:21 (4824): No heartbeat from core client for 30 sec - exiting 11:52:22 (4824): No heartbeat from core client for 30 sec - exiting 11:52:23 (4824): No heartbeat from core client for 30 sec - exiting 11:52:24 (4824): No heartbeat from core client for 30 sec - exiting 11:52:25 (4824): No heartbeat from core client for 30 sec - exiting 11:52:26 (4824): No heartbeat from core client for 30 sec - exiting 11:52:27 (4824): No heartbeat from core client for 30 sec - exiting 11:52:28 (4824): No heartbeat from core client for 30 sec - exiting 11:52:29 (4824): No heartbeat from core client for 30 sec - exiting 11:52:30 (4824): No heartbeat from core client for 30 sec - exiting 11:52:31 (4824): No heartbeat from core client for 30 sec - exiting 11:52:32 (4824): No heartbeat from core client for 30 sec - exiting 11:52:33 (4824): No heartbeat from core client for 30 sec - exiting 11:52:34 (4824): No heartbeat from core client for 30 sec - exiting 11:52:35 (4824): No heartbeat from core client for 30 sec - exiting 11:52:36 (4824): No heartbeat from core client for 30 sec - exiting 11:52:37 (4824): No heartbeat from core client for 30 sec - exiting 11:52:38 (4824): No heartbeat from core client for 30 sec - exiting 11:52:39 (4824): No heartbeat from core client for 30 sec - exiting 11:52:40 (4824): No heartbeat from core client for 30 sec - exiting 11:52:41 (4824): No heartbeat from core client for 30 sec - exiting 11:52:42 (4824): No heartbeat from core client for 30 sec - exiting 11:52:43 (4824): No heartbeat from core client for 30 sec - exiting 11:52:44 (4824): No heartbeat from core client for 30 sec - exiting 11:52:45 (4824): No heartbeat from core client for 30 sec - exiting 11:52:46 (4824): No heartbeat from core client for 30 sec - exiting 11:52:47 (4824): No heartbeat from core client for 30 sec - exiting 11:52:48 (4824): No heartbeat from core client for 30 sec - exiting 11:52:49 (4824): No heartbeat from core client for 30 sec - exiting 11:52:50 (4824): No heartbeat from core client for 30 sec - exiting 11:52:51 (4824): No heartbeat from core client for 30 sec - exiting 11:52:52 (4824): No heartbeat from core client for 30 sec - exiting 11:52:53 (4824): No heartbeat from core client for 30 sec - exiting 11:52:54 (4824): No heartbeat from core client for 30 sec - exiting 11:52:55 (4824): No heartbeat from core client for 30 sec - exiting 11:52:56 (4824): No heartbeat from core client for 30 sec - exiting 11:52:57 (4824): No heartbeat from core client for 30 sec - exiting 11:52:58 (4824): No heartbeat from core client for 30 sec - exiting 11:52:59 (4824): No heartbeat from core client for 30 sec - exiting 11:53:00 (4824): No heartbeat from core client for 30 sec - exiting 11:53:01 (4824): No heartbeat from core client for 30 sec - exiting 11:53:02 (4824): No heartbeat from core client for 30 sec - exiting 11:53:03 (4824): No heartbeat from core client for 30 sec - exiting 11:53:04 (4824): No heartbeat from core client for 30 sec - exiting 11:53:05 (4824): No heartbeat from core client for 30 sec - exiting 11:53:06 (4824): No heartbeat from core client for 30 sec - exiting 11:53:07 (4824): No heartbeat from core client for 30 sec - exiting 11:53:08 (4824): No heartbeat from core client for 30 sec - exiting 11:53:09 (4824): No heartbeat from core client for 30 sec - exiting 11:53:10 (4824): No heartbeat from core client for 30 sec - exiting 11:53:11 (4824): No heartbeat from core client for 30 sec - exiting 11:53:12 (4824): No heartbeat from core client for 30 sec - exiting 11:53:13 (4824): No heartbeat from core client for 30 sec - exiting 11:53:14 (4824): No heartbeat from core client for 30 sec - exiting 11:53:15 (4824): No heartbeat from core client for 30 sec - exiting 11:53:16 (4824): No heartbeat from core client for 30 sec - exiting 11:53:17 (4824): No heartbeat from core client for 30 sec - exiting 11:53:18 (4824): No heartbeat from core client for 30 sec - exiting 11:53:19 (4824): No heartbeat from core client for 30 sec - exiting 11:53:20 (4824): No heartbeat from core client for 30 sec - exiting 11:53:21 (4824): No heartbeat from core client for 30 sec - exiting 11:53:22 (4824): No heartbeat from core client for 30 sec - exiting 11:53:23 (4824): No heartbeat from core client for 30 sec - exiting 11:53:24 (4824): No heartbeat from core client for 30 sec - exiting 11:53:25 (4824): No heartbeat from core client for 30 sec - exiting 11:53:26 (4824): No heartbeat from core client for 30 sec - exiting 11:53:27 (4824): No heartbeat from core client for 30 sec - exiting 11:53:28 (4824): No heartbeat from core client for 30 sec - exiting 11:53:29 (4824): No heartbeat from core client for 30 sec - exiting 11:53:30 (4824): No heartbeat from core client for 30 sec - exiting 11:53:31 (4824): No heartbeat from core client for 30 sec - exiting 11:53:32 (4824): No heartbeat from core client for 30 sec - exiting 11:53:33 (4824): No heartbeat from core client for 30 sec - exiting 11:53:34 (4824): No heartbeat from core client for 30 sec - exiting 11:53:35 (4824): No heartbeat from core client for 30 sec - exiting 11:53:36 (4824): No heartbeat from core client for 30 sec - exiting 11:53:37 (4824): No heartbeat from core client for 30 sec - exiting 11:53:38 (4824): No heartbeat from core client for 30 sec - exiting 11:53:39 (4824): No heartbeat from core client for 30 sec - exiting 11:53:40 (4824): No heartbeat from core client for 30 sec - exiting 11:53:41 (4824): No heartbeat from core client for 30 sec - exiting 11:53:42 (4824): No heartbeat from core client for 30 sec - exiting 11:53:43 (4824): No heartbeat from core client for 30 sec - exiting 11:53:44 (4824): No heartbeat from core client for 30 sec - exiting 11:53:45 (4824): No heartbeat from core client for 30 sec - exiting 11:53:46 (4824): No heartbeat from core client for 30 sec - exiting 11:53:47 (4824): No heartbeat from core client for 30 sec - exiting 11:53:48 (4824): No heartbeat from core client for 30 sec - exiting 11:53:49 (4824): No heartbeat from core client for 30 sec - exiting 11:53:50 (4824): No heartbeat from core client for 30 sec - exiting 11:53:51 (4824): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4832, iMonCtr=1 11:53:52 (4824): No heartbeat from core client for 30 sec - exiting 11:53:53 (4824): No heartbeat from core client for 30 sec - exiting 11:53:54 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:19:30 (3916): No heartbeat from core client for 30 sec - exiting 21:19:31 (3916): No heartbeat from core client for 30 sec - exiting 21:19:32 (3916): No heartbeat from core client for 30 sec - exiting 21:19:33 (3916): No heartbeat from core client for 30 sec - exiting 21:19:34 (3916): No heartbeat from core client for 30 sec - exiting 21:19:35 (3916): No heartbeat from core client for 30 sec - exiting 21:19:36 (3916): No heartbeat from core client for 30 sec - exiting 21:19:37 (3916): No heartbeat from core client for 30 sec - exiting 21:19:38 (3916): No heartbeat from core client for 30 sec - exiting 21:19:39 (3916): No heartbeat from core client for 30 sec - exiting 21:19:40 (3916): No heartbeat from core client for 30 sec - exiting 21:19:42 (3916): No heartbeat from core client for 30 sec - exiting 21:19:43 (3916): No heartbeat from core client for 30 sec - exiting 21:19:44 (3916): No heartbeat from core client for 30 sec - exiting 21:19:45 (3916): No heartbeat from core client for 30 sec - exiting 21:19:46 (3916): No heartbeat from core client for 30 sec - exiting 21:19:47 (3916): No heartbeat from core client for 30 sec - exiting 21:19:48 (3916): No heartbeat from core client for 30 sec - exiting 21:19:49 (3916): No heartbeat from core client for 30 sec - exiting 21:19:50 (3916): No heartbeat from core client for 30 sec - exiting 21:19:51 (3916): No heartbeat from core client for 30 sec - exiting 21:19:52 (3916): No heartbeat from core client for 30 sec - exiting 21:19:54 (3916): No heartbeat from core client for 30 sec - exiting 21:19:55 (3916): No heartbeat from core client for 30 sec - exiting 21:19:56 (3916): No heartbeat from core client for 30 sec - exiting 21:19:57 (3916): No heartbeat from core client for 30 sec - exiting 21:19:58 (3916): No heartbeat from core client for 30 sec - exiting 21:19:59 (3916): No heartbeat from core client for 30 sec - exiting 21:20:00 (3916): No heartbeat from core client for 30 sec - exiting 21:20:01 (3916): No heartbeat from core client for 30 sec - exiting 21:20:02 (3916): No heartbeat from core client for 30 sec - exiting 21:20:03 (3916): No heartbeat from core client for 30 sec - exiting 21:20:05 (3916): No heartbeat from core client for 30 sec - exiting 21:20:06 (3916): No heartbeat from core client for 30 sec - exiting 21:20:07 (3916): No heartbeat from core client for 30 sec - exiting 21:20:08 (3916): No heartbeat from core client for 30 sec - exiting 21:20:09 (3916): No heartbeat from core client for 30 sec - exiting 21:20:10 (3916): No heartbeat from core client for 30 sec - exiting 21:20:11 (3916): No heartbeat from core client for 30 sec - exiting 21:20:12 (3916): No heartbeat from core client for 30 sec - exiting 21:20:13 (3916): No heartbeat from core client for 30 sec - exiting 21:20:14 (3916): No heartbeat from core client for 30 sec - exiting 21:20:15 (3916): No heartbeat from core client for 30 sec - exiting 21:20:17 (3916): No heartbeat from core client for 30 sec - exiting 21:20:18 (3916): No heartbeat from core client for 30 sec - exiting 21:20:19 (3916): No heartbeat from core client for 30 sec - exiting 21:20:20 (3916): No heartbeat from core client for 30 sec - exiting 21:20:21 (3916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4708, selfPID=4708, iMonCtr=2 23:23:56 (5352): No heartbeat from core client for 30 sec - exiting 23:23:57 (5352): No heartbeat from core client for 30 sec - exiting 23:23:58 (5352): No heartbeat from core client for 30 sec - exiting 23:23:59 (5352): No heartbeat from core client for 30 sec - exiting 23:24:00 (5352): No heartbeat from core client for 30 sec - exiting 23:24:01 (5352): No heartbeat from core client for 30 sec - exiting 23:24:02 (5352): No heartbeat from core client for 30 sec - exiting 23:24:03 (5352): No heartbeat from core client for 30 sec - exiting 23:24:04 (5352): No heartbeat from core client for 30 sec - exiting 23:24:05 (5352): No heartbeat from core client for 30 sec - exiting 23:24:07 (5352): No heartbeat from core client for 30 sec - exiting 23:24:08 (5352): No heartbeat from core client for 30 sec - exiting 23:24:09 (5352): No heartbeat from core client for 30 sec - exiting 23:24:10 (5352): No heartbeat from core client for 30 sec - exiting 23:24:11 (5352): No heartbeat from core client for 30 sec - exiting 23:24:12 (5352): No heartbeat from core client for 30 sec - exiting 23:24:13 (5352): No heartbeat from core client for 30 sec - exiting 23:24:14 (5352): No heartbeat from core client for 30 sec - exiting 23:24:15 (5352): No heartbeat from core client for 30 sec - exiting 23:24:16 (5352): No heartbeat from core client for 30 sec - exiting 23:24:17 (5352): No heartbeat from core client for 30 sec - exiting 23:24:19 (5352): No heartbeat from core client for 30 sec - exiting 23:24:20 (5352): No heartbeat from core client for 30 sec - exiting 23:24:21 (5352): No heartbeat from core client for 30 sec - exiting 23:24:22 (5352): No heartbeat from core client for 30 sec - exiting 23:24:23 (5352): No heartbeat from core client for 30 sec - exiting 23:24:24 (5352): No heartbeat from core client for 30 sec - exiting 23:24:25 (5352): No heartbeat from core client for 30 sec - exiting 23:24:26 (5352): No heartbeat from core client for 30 sec - exiting 23:24:27 (5352): No heartbeat from core client for 30 sec - exiting 23:24:28 (5352): No heartbeat from core client for 30 sec - exiting 23:24:29 (5352): No heartbeat from core client for 30 sec - exiting 23:24:31 (5352): No heartbeat from core client for 30 sec - exiting 23:24:32 (5352): No heartbeat from core client for 30 sec - exiting 23:24:33 (5352): No heartbeat from core client for 30 sec - exiting 23:24:34 (5352): No heartbeat from core client for 30 sec - exiting 23:24:35 (5352): No heartbeat from core client for 30 sec - exiting 23:24:36 (5352): No heartbeat from core client for 30 sec - exiting 23:24:37 (5352): No heartbeat from core client for 30 sec - exiting 23:24:38 (5352): No heartbeat from core client for 30 sec - exiting 23:24:39 (5352): No heartbeat from core client for 30 sec - exiting 23:24:41 (5352): No heartbeat from core client for 30 sec - exiting 23:24:42 (5352): No heartbeat from core client for 30 sec - exiting 23:24:43 (5352): No heartbeat from core client for 30 sec - exiting 23:24:44 (5352): No heartbeat from core client for 30 sec - exiting 23:24:45 (5352): No heartbeat from core client for 30 sec - exiting 23:24:46 (5352): No heartbeat from core client for 30 sec - exiting 23:24:47 (5352): No heartbeat from core client for 30 sec - exiting 23:24:48 (5352): No heartbeat from core client for 30 sec - exiting 23:24:49 (5352): No heartbeat from core client for 30 sec - exiting 23:24:50 (5352): No heartbeat from core client for 30 sec - exiting 23:25:25 (5352): No heartbeat from core client for 30 sec - exiting 23:25:26 (5352): No heartbeat from core client for 30 sec - exiting 23:25:28 (5352): No heartbeat from core client for 30 sec - exiting 23:25:29 (5352): No heartbeat from core client for 30 sec - exiting 23:25:30 (5352): No heartbeat from core client for 30 sec - exiting 23:25:31 (5352): No heartbeat from core client for 30 sec - exiting 23:25:32 (5352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:47:33 (5324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8112, selfPID=420, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8452, selfPID=4512, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3276, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:56:41 (4804): No heartbeat from core client for 30 sec - exiting 11:56:42 (4804): No heartbeat from core client for 30 sec - exiting 11:56:43 (4804): No heartbeat from core client for 30 sec - exiting 11:56:44 (4804): No heartbeat from core client for 30 sec - exiting 11:56:45 (4804): No heartbeat from core client for 30 sec - exiting 11:56:46 (4804): No heartbeat from core client for 30 sec - exiting 11:56:47 (4804): No heartbeat from core client for 30 sec - exiting 11:56:48 (4804): No heartbeat from core client for 30 sec - exiting 11:56:49 (4804): No heartbeat from core client for 30 sec - exiting 11:56:51 (4804): No heartbeat from core client for 30 sec - exiting 11:56:52 (4804): No heartbeat from core client for 30 sec - exiting 11:56:53 (4804): No heartbeat from core client for 30 sec - exiting 11:56:54 (4804): No heartbeat from core client for 30 sec - exiting 11:56:55 (4804): No heartbeat from core client for 30 sec - exiting 11:56:56 (4804): No heartbeat from core client for 30 sec - exiting 11:56:57 (4804): No heartbeat from core client for 30 sec - exiting 11:56:58 (4804): No heartbeat from core client for 30 sec - exiting 11:56:59 (4804): No heartbeat from core client for 30 sec - exiting 11:57:00 (4804): No heartbeat from core client for 30 sec - exiting 11:57:01 (4804): No heartbeat from core client for 30 sec - exiting 11:57:03 (4804): No heartbeat from core client for 30 sec - exiting 11:57:04 (4804): No heartbeat from core client for 30 sec - exiting 11:57:05 (4804): No heartbeat from core client for 30 sec - exiting 11:57:06 (4804): No heartbeat from core client for 30 sec - exiting 11:57:07 (4804): No heartbeat from core client for 30 sec - exiting 11:57:08 (4804): No heartbeat from core client for 30 sec - exiting 11:57:09 (4804): No heartbeat from core client for 30 sec - exiting 11:57:10 (4804): No heartbeat from core client for 30 sec - exiting 11:57:11 (4804): No heartbeat from core client for 30 sec - exiting 11:57:12 (4804): No heartbeat from core client for 30 sec - exiting 11:57:13 (4804): No heartbeat from core client for 30 sec - exiting 11:57:15 (4804): No heartbeat from core client for 30 sec - exiting 11:57:16 (4804): No heartbeat from core client for 30 sec - exiting 11:57:17 (4804): No heartbeat from core client for 30 sec - exiting 11:57:18 (4804): No heartbeat from core client for 30 sec - exiting 11:57:19 (4804): No heartbeat from core client for 30 sec - exiting 11:57:20 (4804): No heartbeat from core client for 30 sec - exiting 11:57:21 (4804): No heartbeat from core client for 30 sec - exiting 11:57:22 (4804): No heartbeat from core client for 30 sec - exiting 11:57:23 (4804): No heartbeat from core client for 30 sec - exiting 11:57:24 (4804): No heartbeat from core client for 30 sec - exiting 11:57:25 (4804): No heartbeat from core client for 30 sec - exiting 11:57:27 (4804): No heartbeat from core client for 30 sec - exiting 11:57:28 (4804): No heartbeat from core client for 30 sec - exiting 11:57:29 (4804): No heartbeat from core client for 30 sec - exiting 11:57:30 (4804): No heartbeat from core client for 30 sec - exiting 11:57:31 (4804): No heartbeat from core client for 30 sec - exiting 11:57:32 (4804): No heartbeat from core client for 30 sec - exiting 11:57:33 (4804): No heartbeat from core client for 30 sec - exiting 11:57:34 (4804): No heartbeat from core client for 30 sec - exiting 11:57:35 (4804): No heartbeat from core client for 30 sec - exiting 11:57:36 (4804): No heartbeat from core client for 30 sec - exiting 11:57:38 (4804): No heartbeat from core client for 30 sec - exiting 11:57:39 (4804): No heartbeat from core client for 30 sec - exiting 11:57:40 (4804): No heartbeat from core client for 30 sec - exiting 11:57:41 (4804): No heartbeat from core client for 30 sec - exiting 11:57:42 (4804): No heartbeat from core client for 30 sec - exiting 11:57:43 (4804): No heartbeat from core client for 30 sec - exiting 11:57:44 (4804): No heartbeat from core client for 30 sec - exiting 11:57:45 (4804): No heartbeat from core client for 30 sec - exiting 11:57:46 (4804): No heartbeat from core client for 30 sec - exiting 11:57:47 (4804): No heartbeat from core client for 30 sec - exiting 11:57:48 (4804): No heartbeat from core client for 30 sec - exiting 11:57:50 (4804): No heartbeat from core client for 30 sec - exiting 11:57:51 (4804): No heartbeat from core client for 30 sec - exiting 11:57:52 (4804): No heartbeat from core client for 30 sec - exiting 11:57:53 (4804): No heartbeat from core client for 30 sec - exiting 11:57:54 (4804): No heartbeat from core client for 30 sec - exiting 11:57:55 (4804): No heartbeat from core client for 30 sec - exiting 11:57:56 (4804): No heartbeat from core client for 30 sec - exiting 11:57:57 (4804): No heartbeat from core client for 30 sec - exiting 11:57:58 (4804): No heartbeat from core client for 30 sec - exiting 11:57:59 (4804): No heartbeat from core client for 30 sec - exiting 11:58:00 (4804): No heartbeat from core client for 30 sec - exiting 11:58:02 (4804): No heartbeat from core client for 30 sec - exiting 11:58:03 (4804): No heartbeat from core client for 30 sec - exiting 11:58:04 (4804): No heartbeat from core client for 30 sec - exiting 11:58:05 (4804): No heartbeat from core client for 30 sec - exiting 11:58:06 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:05:09 (5244): No heartbeat from core client for 30 sec - exiting 10:05:10 (5244): No heartbeat from core client for 30 sec - exiting 10:05:11 (5244): No heartbeat from core client for 30 sec - exiting 10:05:12 (5244): No heartbeat from core client for 30 sec - exiting 10:05:13 (5244): No heartbeat from core client for 30 sec - exiting 10:05:14 (5244): No heartbeat from core client for 30 sec - exiting 10:05:15 (5244): No heartbeat from core client for 30 sec - exiting 10:05:16 (5244): No heartbeat from core client for 30 sec - exiting 10:05:18 (5244): No heartbeat from core client for 30 sec - exiting 10:05:19 (5244): No heartbeat from core client for 30 sec - exiting 10:05:20 (5244): No heartbeat from core client for 30 sec - exiting 10:05:21 (5244): No heartbeat from core client for 30 sec - exiting 10:05:22 (5244): No heartbeat from core client for 30 sec - exiting 10:05:23 (5244): No heartbeat from core client for 30 sec - exiting 10:05:24 (5244): No heartbeat from core client for 30 sec - exiting 10:05:25 (5244): No heartbeat from core client for 30 sec - exiting 10:05:26 (5244): No heartbeat from core client for 30 sec - exiting 10:05:27 (5244): No heartbeat from core client for 30 sec - exiting 10:05:28 (5244): No heartbeat from core client for 30 sec - exiting 10:05:30 (5244): No heartbeat from core client for 30 sec - exiting 10:05:31 (5244): No heartbeat from core client for 30 sec - exiting 10:05:32 (5244): No heartbeat from core client for 30 sec - exiting 10:05:33 (5244): No heartbeat from core client for 30 sec - exiting 10:05:34 (5244): No heartbeat from core client for 30 sec - exiting 10:05:35 (5244): No heartbeat from core client for 30 sec - exiting 10:05:36 (5244): No heartbeat from core client for 30 sec - exiting 10:05:37 (5244): No heartbeat from core client for 30 sec - exiting 10:05:38 (5244): No heartbeat from core client for 30 sec - exiting 10:05:39 (5244): No heartbeat from core client for 30 sec - exiting 10:05:40 (5244): No heartbeat from core client for 30 sec - exiting 10:05:42 (5244): No heartbeat from core client for 30 sec - exiting 10:05:43 (5244): No heartbeat from core client for 30 sec - exiting 10:05:44 (5244): No heartbeat from core client for 30 sec - exiting 10:05:45 (5244): No heartbeat from core client for 30 sec - exiting 10:05:46 (5244): No heartbeat from core client for 30 sec - exiting 10:05:47 (5244): No heartbeat from core client for 30 sec - exiting 10:05:48 (5244): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=6968, iMonCtr=1 CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:39:06 (3888): No heartbeat from core client for 30 sec - exiting 19:39:07 (3888): No heartbeat from core client for 30 sec - exiting 19:39:08 (3888): No heartbeat from core client for 30 sec - exiting 19:39:09 (3888): No heartbeat from core client for 30 sec - exiting 19:39:10 (3888): No heartbeat from core client for 30 sec - exiting 19:39:11 (3888): No heartbeat from core client for 30 sec - exiting 19:39:12 (3888): No heartbeat from core client for 30 sec - exiting 19:39:13 (3888): No heartbeat from core client for 30 sec - exiting 19:39:14 (3888): No heartbeat from core client for 30 sec - exiting 19:39:16 (3888): No heartbeat from core client for 30 sec - exiting 19:39:17 (3888): No heartbeat from core client for 30 sec - exiting 19:39:18 (3888): No heartbeat from core client for 30 sec - exiting 19:39:19 (3888): No heartbeat from core client for 30 sec - exiting 19:39:20 (3888): No heartbeat from core client for 30 sec - exiting 19:39:21 (3888): No heartbeat from core client for 30 sec - exiting 19:39:22 (3888): No heartbeat from core client for 30 sec - exiting 19:39:23 (3888): No heartbeat from core client for 30 sec - exiting 19:39:24 (3888): No heartbeat from core client for 30 sec - exiting 19:39:25 (3888): No heartbeat from core client for 30 sec - exiting 19:39:26 (3888): No heartbeat from core client for 30 sec - exiting 19:39:28 (3888): No heartbeat from core client for 30 sec - exiting 19:39:29 (3888): No heartbeat from core client for 30 sec - exiting 19:39:30 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=2624, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7268, selfPID=7268, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7268, selfPID=4516, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_radc_2012_1_008743054_2_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_radc_2012_1_008743054_2_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_radc_2012_1_008743054_2_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_radc_2012_1_008743054_2_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_radc_2012_1_008743054_2_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_radc_2012_1_008743054_2_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_radc_2012_1_008743054_2_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_radc_2012_1_008743054_2_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_radc_2012_1_008743054_2_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Jun 2014 14:04:54	1322841	16659236	hadam3p_anz_radc_2012_1_008743054_2	34,859	267,494	7.6736
10 Jun 2014 09:03:34	1322841	16659236	hadam3p_anz_radc_2012_1_008743054_2	23,339	181,233	7.7652
04 Jun 2014 14:06:54	1322841	16659236	hadam3p_anz_radc_2012_1_008743054_2	11,819	94,363	7.9840