Task 18332322

Name	hadam3p_anz_e1hr_2013_1_009758646_0
Workunit	9829684
Created	20 Apr 2015, 19:02:29 UTC
Sent	20 Apr 2015, 19:20:44 UTC
Report deadline	2 Apr 2016, 0:40:44 UTC
Received	30 Apr 2015, 19:12:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	994306
Run time	2 days 12 hours 54 min 12 sec
CPU time	2 days 12 hours 14 min 35 sec
Validate state	Invalid
Credit	2,993.82
Device peak FLOPS	4.66 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6248, iMonCtr=2 Model crash detected, will try to restart... 19:26:09 (4216): No heartbeat from core client for 30 sec - exiting 19:26:10 (4216): No heartbeat from core client for 30 sec - exiting 19:26:11 (4216): No heartbeat from core client for 30 sec - exiting 19:26:12 (4216): No heartbeat from core client for 30 sec - exiting 19:26:13 (4216): No heartbeat from core client for 30 sec - exiting 19:26:14 (4216): No heartbeat from core client for 30 sec - exiting 19:26:15 (4216): No heartbeat from core client for 30 sec - exiting 19:26:16 (4216): No heartbeat from core client for 30 sec - exiting 19:26:17 (4216): No heartbeat from core client for 30 sec - exiting 19:26:18 (4216): No heartbeat from core client for 30 sec - exiting 19:26:19 (4216): No heartbeat from core client for 30 sec - exiting 19:26:20 (4216): No heartbeat from core client for 30 sec - exiting 19:26:21 (4216): No heartbeat from core client for 30 sec - exiting 19:26:22 (4216): No heartbeat from core client for 30 sec - exiting 19:26:23 (4216): No heartbeat from core client for 30 sec - exiting 19:26:24 (4216): No heartbeat from core client for 30 sec - exiting 19:26:25 (4216): No heartbeat from core client for 30 sec - exiting 19:26:26 (4216): No heartbeat from core client for 30 sec - exiting 19:26:27 (4216): No heartbeat from core client for 30 sec - exiting 19:26:28 (4216): No heartbeat from core client for 30 sec - exiting 19:26:29 (4216): No heartbeat from core client for 30 sec - exiting 19:26:30 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C19:36:56 (4024): No heartbeat from core client for 30 sec - exiting 19:36:58 (4024): No heartbeat from core client for 30 sec - exiting 19:36:59 (4024): No heartbeat from core client for 30 sec - exiting 19:37:00 (4024): No heartbeat from core client for 30 sec - exiting 19:37:01 (4024): No heartbeat from core client for 30 sec - exiting 19:37:02 (4024): No heartbeat from core client for 30 sec - exiting 19:37:03 (4024): No heartbeat from core client for 30 sec - exiting 19:37:04 (4024): No heartbeat from core client for 30 sec - exiting 19:37:05 (4024): No heartbeat from core client for 30 sec - exiting 19:37:06 (4024): No heartbeat from core client for 30 sec - exiting 19:37:07 (4024): No heartbeat from core client for 30 sec - exiting 19:37:08 (4024): No heartbeat from core client for 30 sec - exiting 19:37:10 (4024): No heartbeat from core client for 30 sec - exiting 19:37:11 (4024): No heartbeat from core client for 30 sec - exiting 19:37:12 (4024): No heartbeat from core client for 30 sec - exiting 19:37:13 (4024): No heartbeat from core client for 30 sec - exiting 19:37:14 (4024): No heartbeat from core client for 30 sec - exiting 19:37:15 (4024): No heartbeat from core client for 30 sec - exiting 19:37:16 (4024): No heartbeat from core client for 30 sec - exiting 19:37:17 (4024): No heartbeat from core client for 30 sec - exiting 19:37:18 (4024): No heartbeat from core client for 30 sec - exiting 19:37:19 (4024): No heartbeat from core client for 30 sec - exiting 19:37:21 (4024): No heartbeat from core client for 30 sec - exiting 19:37:22 (4024): No heartbeat from core client for 30 sec - exiting 19:37:23 (4024): No heartbeat from core client for 30 sec - exiting 19:37:24 (4024): No heartbeat from core client for 30 sec - exiting 19:37:25 (4024): No heartbeat from core client for 30 sec - exiting 19:37:26 (4024): No heartbeat from core client for 30 sec - exiting 19:37:27 (4024): No heartbeat from core client for 30 sec - exiting 19:37:28 (4024): No heartbeat from core client for 30 sec - exiting 19:37:29 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:00 (3752): No heartbeat from core client for 30 sec - exiting 18:50:02 (3752): No heartbeat from core client for 30 sec - exiting 18:50:03 (3752): No heartbeat from core client for 30 sec - exiting 18:50:04 (3752): No heartbeat from core client for 30 sec - exiting 18:50:05 (3752): No heartbeat from core client for 30 sec - exiting 18:50:06 (3752): No heartbeat from core client for 30 sec - exiting 18:50:07 (3752): No heartbeat from core client for 30 sec - exiting 18:50:08 (3752): No heartbeat from core client for 30 sec - exiting 18:50:09 (3752): No heartbeat from core client for 30 sec - exiting 18:50:10 (3752): No heartbeat from core client for 30 sec - exiting 18:50:11 (3752): No heartbeat from core client for 30 sec - exiting 18:50:13 (3752): No heartbeat from core client for 30 sec - exiting 18:50:14 (3752): No heartbeat from core client for 30 sec - exiting 18:50:15 (3752): No heartbeat from core client for 30 sec - exiting 18:50:16 (3752): No heartbeat from core client for 30 sec - exiting 18:50:17 (3752): No heartbeat from core client for 30 sec - exiting 18:50:18 (3752): No heartbeat from core client for 30 sec - exiting 18:50:19 (3752): No heartbeat from core client for 30 sec - exiting 18:50:20 (3752): No heartbeat from core client for 30 sec - exiting 18:50:21 (3752): No heartbeat from core client for 30 sec - exiting 18:50:22 (3752): No heartbeat from core client for 30 sec - exiting 18:50:23 (3752): No heartbeat from core client for 30 sec - exiting 18:50:25 (3752): No heartbeat from core client for 30 sec - exiting 18:50:26 (3752): No heartbeat from core client for 30 sec - exiting 18:50:27 (3752): No heartbeat from core client for 30 sec - exiting 18:50:28 (3752): No heartbeat from core client for 30 sec - exiting 18:50:29 (3752): No heartbeat from core client for 30 sec - exiting 18:50:30 (3752): No heartbeat from core client for 30 sec - exiting 18:50:31 (3752): No heartbeat from core client for 30 sec - exiting 18:50:32 (3752): No heartbeat from core client for 30 sec - exiting 18:50:33 (3752): No heartbeat from core client for 30 sec - exiting 18:50:34 (3752): No heartbeat from core client for 30 sec - exiting 18:50:35 (3752): No heartbeat from core client for 30 sec - exiting 18:50:37 (3752): No heartbeat from core client for 30 sec - exiting 18:50:38 (3752): No heartbeat from core client for 30 sec - exiting 18:50:39 (3752): No heartbeat from core client for 30 sec - exiting 18:50:40 (3752): No heartbeat from core client for 30 sec - exiting 18:50:41 (3752): No heartbeat from core client for 30 sec - exiting 18:50:42 (3752): No heartbeat from core client for 30 sec - exiting 18:50:43 (3752): No heartbeat from core client for 30 sec - exiting 18:50:44 (3752): No heartbeat from core client for 30 sec - exiting 18:50:45 (3752): No heartbeat from core client for 30 sec - exiting 18:50:46 (3752): No heartbeat from core client for 30 sec - exiting 18:50:47 (3752): No heartbeat from core client for 30 sec - exiting 18:50:49 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:25:08 (2760): No heartbeat from core client for 30 sec - exiting 21:25:09 (2760): No heartbeat from core client for 30 sec - exiting 21:25:10 (2760): No heartbeat from core client for 30 sec - exiting 21:25:11 (2760): No heartbeat from core client for 30 sec - exiting 21:25:12 (2760): No heartbeat from core client for 30 sec - exiting 21:25:13 (2760): No heartbeat from core client for 30 sec - exiting 21:25:14 (2760): No heartbeat from core client for 30 sec - exiting 21:25:15 (2760): No heartbeat from core client for 30 sec - exiting 21:25:17 (2760): No heartbeat from core client for 30 sec - exiting 21:25:18 (2760): No heartbeat from core client for 30 sec - exiting 21:25:19 (2760): No heartbeat from core client for 30 sec - exiting 21:25:20 (2760): No heartbeat from core client for 30 sec - exiting 21:25:21 (2760): No heartbeat from core client for 30 sec - exiting 21:25:22 (2760): No heartbeat from core client for 30 sec - exiting 21:25:23 (2760): No heartbeat from core client for 30 sec - exiting 21:25:24 (2760): No heartbeat from core client for 30 sec - exiting 21:25:25 (2760): No heartbeat from core client for 30 sec - exiting 21:25:26 (2760): No heartbeat from core client for 30 sec - exiting 21:25:27 (2760): No heartbeat from core client for 30 sec - exiting 21:25:29 (2760): No heartbeat from core client for 30 sec - exiting 21:25:30 (2760): No heartbeat from core client for 30 sec - exiting 21:25:31 (2760): No heartbeat from core client for 30 sec - exiting 21:25:32 (2760): No heartbeat from core client for 30 sec - exiting 21:25:33 (2760): No heartbeat from core client for 30 sec - exiting 21:25:34 (2760): No heartbeat from core client for 30 sec - exiting 21:25:35 (2760): No heartbeat from core client for 30 sec - exiting 21:25:36 (2760): No heartbeat from core client for 30 sec - exiting 21:25:37 (2760): No heartbeat from core client for 30 sec - exiting 21:25:38 (2760): No heartbeat from core client for 30 sec - exiting 21:25:39 (2760): No heartbeat from core client for 30 sec - exiting 21:25:41 (2760): No heartbeat from core client for 30 sec - exiting 21:25:42 (2760): No heartbeat from core client for 30 sec - exiting 21:25:43 (2760): No heartbeat from core client for 30 sec - exiting 21:25:44 (2760): No heartbeat from core client for 30 sec - exiting 21:25:45 (2760): No heartbeat from core client for 30 sec - exiting 21:25:46 (2760): No heartbeat from core client for 30 sec - exiting 21:25:47 (2760): No heartbeat from core client for 30 sec - exiting 21:25:48 (2760): No heartbeat from core client for 30 sec - exiting 21:25:49 (2760): No heartbeat from core client for 30 sec - exiting 21:25:50 (2760): No heartbeat from core client for 30 sec - exiting 21:25:51 (2760): No heartbeat from core client for 30 sec - exiting 21:25:53 (2760): No heartbeat from core client for 30 sec - exiting 21:25:54 (2760): No heartbeat from core client for 30 sec - exiting 21:25:55 (2760): No heartbeat from core client for 30 sec - exiting 21:25:56 (2760): No heartbeat from core client for 30 sec - exiting 21:25:57 (2760): No heartbeat from core client for 30 sec - exiting 21:25:58 (2760): No heartbeat from core client for 30 sec - exiting 21:25:59 (2760): No heartbeat from core client for 30 sec - exiting 21:26:00 (2760): No heartbeat from core client for 30 sec - exiting 21:26:01 (2760): No heartbeat from core client for 30 sec - exiting 21:26:02 (2760): No heartbeat from core client for 30 sec - exiting 21:26:03 (2760): No heartbeat from core client for 30 sec - exiting 21:26:05 (2760): No heartbeat from core client for 30 sec - exiting 21:26:06 (2760): No heartbeat from core client for 30 sec - exiting 21:26:07 (2760): No heartbeat from core client for 30 sec - exiting 21:26:08 (2760): No heartbeat from core client for 30 sec - exiting 21:26:09 (2760): No heartbeat from core client for 30 sec - exiting 21:26:10 (2760): No heartbeat from core client for 30 sec - exiting 21:26:11 (2760): No heartbeat from core client for 30 sec - exiting 21:26:12 (2760): No heartbeat from core client for 30 sec - exiting 21:26:13 (2760): No heartbeat from core client for 30 sec - exiting 21:26:14 (2760): No heartbeat from core client for 30 sec - exiting 21:26:16 (2760): No heartbeat from core client for 30 sec - exiting 21:26:17 (2760): No heartbeat from core client for 30 sec - exiting 21:26:18 (2760): No heartbeat from core client for 30 sec - exiting 21:26:19 (2760): No heartbeat from core client for 30 sec - exiting 21:26:20 (2760): No heartbeat from core client for 30 sec - exiting 21:26:21 (2760): No heartbeat from core client for 30 sec - exiting 21:26:22 (2760): No heartbeat from core client for 30 sec - exiting 21:26:23 (2760): No heartbeat from core client for 30 sec - exiting 21:26:24 (2760): No heartbeat from core client for 30 sec - exiting 21:26:25 (2760): No heartbeat from core client for 30 sec - exiting 21:26:26 (2760): No heartbeat from core client for 30 sec - exiting 21:26:28 (2760): No heartbeat from core client for 30 sec - exiting 21:26:29 (2760): No heartbeat from core client for 30 sec - exiting 21:26:30 (2760): No heartbeat from core client for 30 sec - exiting 21:26:31 (2760): No heartbeat from core client for 30 sec - exiting 21:26:32 (2760): No heartbeat from core client for 30 sec - exiting 21:26:33 (2760): No heartbeat from core client for 30 sec - exiting 21:26:34 (2760): No heartbeat from core client for 30 sec - exiting 21:26:35 (2760): No heartbeat from core client for 30 sec - exiting 21:26:36 (2760): No heartbeat from core client for 30 sec - exiting 21:26:37 (2760): No heartbeat from core client for 30 sec - exiting 21:26:38 (2760): No heartbeat from core client for 30 sec - exiting 21:26:40 (2760): No heartbeat from core client for 30 sec - exiting 21:26:41 (2760): No heartbeat from core client for 30 sec - exiting 21:26:42 (2760): No heartbeat from core client for 30 sec - exiting 21:26:43 (2760): No heartbeat from core client for 30 sec - exiting 21:26:44 (2760): No heartbeat from core client for 30 sec - exiting 21:26:45 (2760): No heartbeat from core client for 30 sec - exiting 21:26:46 (2760): No heartbeat from core client for 30 sec - exiting 21:26:47 (2760): No heartbeat from core client for 30 sec - exiting 21:26:48 (2760): No heartbeat from core client for 30 sec - exiting 21:26:49 (2760): No heartbeat from core client for 30 sec - exiting 21:26:50 (2760): No heartbeat from core client for 30 sec - exiting 21:26:52 (2760): No heartbeat from core client for 30 sec - exiting 21:26:53 (2760): No heartbeat from core client for 30 sec - exiting 21:26:54 (2760): No heartbeat from core client for 30 sec - exiting 21:26:55 (2760): No heartbeat from core client for 30 sec - exiting 21:26:56 (2760): No heartbeat from core client for 30 sec - exiting 21:26:57 (2760): No heartbeat from core client for 30 sec - exiting 21:26:58 (2760): No heartbeat from core client for 30 sec - exiting 21:26:59 (2760): No heartbeat from core client for 30 sec - exiting 21:27:00 (2760): No heartbeat from core client for 30 sec - exiting 21:27:01 (2760): No heartbeat from core client for 30 sec - exiting 21:27:02 (2760): No heartbeat from core client for 30 sec - exiting 21:27:04 (2760): No heartbeat from core client for 30 sec - exiting 21:27:05 (2760): No heartbeat from core client for 30 sec - exiting 21:27:06 (2760): No heartbeat from core client for 30 sec - exiting 21:27:07 (2760): No heartbeat from core client for 30 sec - exiting 21:27:08 (2760): No heartbeat from core client for 30 sec - exiting 21:27:09 (2760): No heartbeat from core client for 30 sec - exiting 21:27:10 (2760): No heartbeat from core client for 30 sec - exiting 21:27:11 (2760): No heartbeat from core client for 30 sec - exiting 21:27:12 (2760): No heartbeat from core client for 30 sec - exiting 21:27:13 (2760): No heartbeat from core client for 30 sec - exiting 21:27:14 (2760): No heartbeat from core client for 30 sec - exiting 21:27:16 (2760): No heartbeat from core client for 30 sec - exiting 21:27:17 (2760): No heartbeat from core client for 30 sec - exiting 21:27:18 (2760): No heartbeat from core client for 30 sec - exiting 21:27:19 (2760): No heartbeat from core client for 30 sec - exiting 21:27:20 (2760): No heartbeat from core client for 30 sec - exiting 21:27:21 (2760): No heartbeat from core client for 30 sec - exiting 21:27:22 (2760): No heartbeat from core client for 30 sec - exiting 21:27:23 (2760): No heartbeat from core client for 30 sec - exiting 21:27:24 (2760): No heartbeat from core client for 30 sec - exiting 21:27:25 (2760): No heartbeat from core client for 30 sec - exiting 21:27:26 (2760): No heartbeat from core client for 30 sec - exiting 21:27:28 (2760): No heartbeat from core client for 30 sec - exiting 21:27:29 (2760): No heartbeat from core client for 30 sec - exiting 21:27:30 (2760): No heartbeat from core client for 30 sec - exiting 21:27:31 (2760): No heartbeat from core client for 30 sec - exiting 21:27:32 (2760): No heartbeat from core client for 30 sec - exiting 21:27:33 (2760): No heartbeat from core client for 30 sec - exiting 21:27:34 (2760): No heartbeat from core client for 30 sec - exiting 21:27:35 (2760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:34:00 (6344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:49:59 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:51:11 (6284): No heartbeat from core client for 30 sec - exiting 22:51:12 (6284): No heartbeat from core client for 30 sec - exiting 22:51:43 (6284): No heartbeat from core client for 30 sec - exiting 22:51:45 (6284): No heartbeat from core client for 30 sec - exiting 22:51:46 (6284): No heartbeat from core client for 30 sec - exiting 22:51:48 (6284): No heartbeat from core client for 30 sec - exiting 22:51:49 (6284): No heartbeat from core client for 30 sec - exiting 22:51:50 (6284): No heartbeat from core client for 30 sec - exiting 22:51:53 (6284): No heartbeat from core client for 30 sec - exiting 22:51:54 (6284): No heartbeat from core client for 30 sec - exiting 22:51:56 (6284): No heartbeat from core client for 30 sec - exiting 22:51:58 (6284): No heartbeat from core client for 30 sec - exiting 22:52:00 (6284): No heartbeat from core client for 30 sec - exiting 22:52:01 (6284): No heartbeat from core client for 30 sec - exiting 22:52:03 (6284): No heartbeat from core client for 30 sec - exiting 22:52:06 (6284): No heartbeat from core client for 30 sec - exiting 22:52:07 (6284): No heartbeat from core client for 30 sec - exiting 22:52:10 (6284): No heartbeat from core client for 30 sec - exiting 22:52:12 (6284): No heartbeat from core client for 30 sec - exiting 22:52:14 (6284): No heartbeat from core client for 30 sec - exiting 22:52:16 (6284): No heartbeat from core client for 30 sec - exiting 22:52:17 (6284): No heartbeat from core client for 30 sec - exiting 22:52:19 (6284): No heartbeat from core client for 30 sec - exiting 22:52:22 (6284): No heartbeat from core client for 30 sec - exiting 22:52:24 (6284): No heartbeat from core client for 30 sec - exiting 22:52:27 (6284): No heartbeat from core client for 30 sec - exiting 22:52:29 (6284): No heartbeat from core client for 30 sec - exiting 22:52:32 (6284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=212, iMonCtr=2 Model crash detected, will try to restart... 07:31:55 (3104): No heartbeat from core client for 30 sec - exiting 07:31:57 (3104): No heartbeat from core client for 30 sec - exiting 07:31:58 (3104): No heartbeat from core client for 30 sec - exiting 07:31:59 (3104): No heartbeat from core client for 30 sec - exiting 07:32:00 (3104): No heartbeat from core client for 30 sec - exiting 07:32:01 (3104): No heartbeat from core client for 30 sec - exiting 07:32:02 (3104): No heartbeat from core client for 30 sec - exiting 07:32:03 (3104): No heartbeat from core client for 30 sec - exiting 07:32:04 (3104): No heartbeat from core client for 30 sec - exiting 07:32:05 (3104): No heartbeat from core client for 30 sec - exiting 07:32:06 (3104): No heartbeat from core client for 30 sec - exiting 07:32:07 (3104): No heartbeat from core client for 30 sec - exiting 07:32:09 (3104): No heartbeat from core client for 30 sec - exiting 07:32:10 (3104): No heartbeat from core client for 30 sec - exiting 07:32:11 (3104): No heartbeat from core client for 30 sec - exiting 07:32:12 (3104): No heartbeat from core client for 30 sec - exiting 07:32:13 (3104): No heartbeat from core client for 30 sec - exiting 07:32:14 (3104): No heartbeat from core client for 30 sec - exiting 07:32:15 (3104): No heartbeat from core client for 30 sec - exiting 07:32:16 (3104): No heartbeat from core client for 30 sec - exiting 07:32:17 (3104): No heartbeat from core client for 30 sec - exiting 07:32:18 (3104): No heartbeat from core client for 30 sec - exiting 07:32:20 (3104): No heartbeat from core client for 30 sec - exiting 07:32:21 (3104): No heartbeat from core client for 30 sec - exiting 07:32:22 (3104): No heartbeat from core client for 30 sec - exiting 07:32:23 (3104): No heartbeat from core client for 30 sec - exiting 07:32:24 (3104): No heartbeat from core client for 30 sec - exiting 07:32:25 (3104): No heartbeat from core client for 30 sec - exiting 07:32:26 (3104): No heartbeat from core client for 30 sec - exiting 07:32:27 (3104): No heartbeat from core client for 30 sec - exiting 07:32:28 (3104): No heartbeat from core client for 30 sec - exiting 07:32:29 (3104): No heartbeat from core client for 30 sec - exiting 07:32:30 (3104): No heartbeat from core client for 30 sec - exiting 07:32:32 (3104): No heartbeat from core client for 30 sec - exiting 07:32:33 (3104): No heartbeat from core client for 30 sec - exiting 07:32:34 (3104): No heartbeat from core client for 30 sec - exiting 07:32:35 (3104): No heartbeat from core client for 30 sec - exiting 07:32:36 (3104): No heartbeat from core client for 30 sec - exiting 07:32:37 (3104): No heartbeat from core client for 30 sec - exiting 07:32:38 (3104): No heartbeat from core client for 30 sec - exiting 07:32:39 (3104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:19 (4036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:52 (6192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:03:33 (6768): No heartbeat from core client for 30 sec - exiting 08:03:34 (6768): No heartbeat from core client for 30 sec - exiting 08:03:35 (6768): No heartbeat from core client for 30 sec - exiting 08:03:36 (6768): No heartbeat from core client for 30 sec - exiting 08:03:37 (6768): No heartbeat from core client for 30 sec - exiting 08:03:38 (6768): No heartbeat from core client for 30 sec - exiting 08:03:39 (6768): No heartbeat from core client for 30 sec - exiting 08:03:40 (6768): No heartbeat from core client for 30 sec - exiting 08:03:41 (6768): No heartbeat from core client for 30 sec - exiting 08:03:42 (6768): No heartbeat from core client for 30 sec - exiting 08:03:44 (6768): No heartbeat from core client for 30 sec - exiting 08:03:45 (6768): No heartbeat from core client for 30 sec - exiting 08:03:46 (6768): No heartbeat from core client for 30 sec - exiting 08:03:47 (6768): No heartbeat from core client for 30 sec - exiting 08:03:48 (6768): No heartbeat from core client for 30 sec - exiting 08:03:49 (6768): No heartbeat from core client for 30 sec - exiting 08:03:50 (6768): No heartbeat from core client for 30 sec - exiting 08:03:51 (6768): No heartbeat from core client for 30 sec - exiting 08:03:52 (6768): No heartbeat from core client for 30 sec - exiting 08:03:53 (6768): No heartbeat from core client for 30 sec - exiting 08:03:54 (6768): No heartbeat from core client for 30 sec - exiting 08:03:56 (6768): No heartbeat from core client for 30 sec - exiting 08:03:57 (6768): No heartbeat from core client for 30 sec - exiting 08:03:58 (6768): No heartbeat from core client for 30 sec - exiting 08:03:59 (6768): No heartbeat from core client for 30 sec - exiting 08:04:00 (6768): No heartbeat from core client for 30 sec - exiting 08:04:01 (6768): No heartbeat from core client for 30 sec - exiting 08:04:02 (6768): No heartbeat from core client for 30 sec - exiting 08:04:03 (6768): No heartbeat from core client for 30 sec - exiting 08:04:04 (6768): No heartbeat from core client for 30 sec - exiting 08:04:05 (6768): No heartbeat from core client for 30 sec - exiting 08:04:07 (6768): No heartbeat from core client for 30 sec - exiting 08:04:08 (6768): No heartbeat from core client for 30 sec - exiting 08:04:09 (6768): No heartbeat from core client for 30 sec - exiting 08:04:10 (6768): No heartbeat from core client for 30 sec - exiting 08:04:11 (6768): No heartbeat from core client for 30 sec - exiting 08:04:12 (6768): No heartbeat from core client for 30 sec - exiting 08:04:13 (6768): No heartbeat from core client for 30 sec - exiting 08:04:14 (6768): No heartbeat from core client for 30 sec - exiting 08:04:15 (6768): No heartbeat from core client for 30 sec - exiting 08:04:16 (6768): No heartbeat from core client for 30 sec - exiting 08:04:17 (6768): No heartbeat from core client for 30 sec - exiting 08:04:19 (6768): No heartbeat from core client for 30 sec - exiting 08:04:20 (6768): No heartbeat from core client for 30 sec - exiting 08:04:21 (6768): No heartbeat from core client for 30 sec - exiting 08:04:22 (6768): No heartbeat from core client for 30 sec - exiting 08:04:23 (6768): No heartbeat from core client for 30 sec - exiting 08:04:24 (6768): No heartbeat from core client for 30 sec - exiting 08:04:25 (6768): No heartbeat from core client for 30 sec - exiting 08:04:26 (6768): No heartbeat from core client for 30 sec - exiting 08:04:27 (6768): No heartbeat from core client for 30 sec - exiting 08:04:28 (6768): No heartbeat from core client for 30 sec - exiting 08:04:29 (6768): No heartbeat from core client for 30 sec - exiting 08:04:31 (6768): No heartbeat from core client for 30 sec - exiting 08:04:32 (6768): No heartbeat from core client for 30 sec - exiting 08:04:33 (6768): No heartbeat from core client for 30 sec - exiting 08:04:34 (6768): No heartbeat from core client for 30 sec - exiting 08:04:35 (6768): No heartbeat from core client for 30 sec - exiting 08:04:36 (6768): No heartbeat from core client for 30 sec - exiting 08:04:37 (6768): No heartbeat from core client for 30 sec - exiting 08:04:38 (6768): No heartbeat from core client for 30 sec - exiting 08:04:39 (6768): No heartbeat from core client for 30 sec - exiting 08:04:40 (6768): No heartbeat from core client for 30 sec - exiting 08:04:41 (6768): No heartbeat from core client for 30 sec - exiting 08:04:43 (6768): No heartbeat from core client for 30 sec - exiting 08:04:44 (6768): No heartbeat from core client for 30 sec - exiting 08:04:45 (6768): No heartbeat from core client for 30 sec - exiting 08:04:46 (6768): No heartbeat from core client for 30 sec - exiting 08:04:47 (6768): No heartbeat from core client for 30 sec - exiting 08:04:48 (6768): No heartbeat from core client for 30 sec - exiting 08:04:49 (6768): No heartbeat from core client for 30 sec - exiting 08:04:50 (6768): No heartbeat from core client for 30 sec - exiting 08:04:51 (6768): No heartbeat from core client for 30 sec - exiting 08:04:52 (6768): No heartbeat from core client for 30 sec - exiting 08:04:53 (6768): No heartbeat from core client for 30 sec - exiting 08:04:55 (6768): No heartbeat from core client for 30 sec - exiting 08:04:56 (6768): No heartbeat from core client for 30 sec - exiting 08:04:57 (6768): No heartbeat from core client for 30 sec - exiting 08:04:58 (6768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:47 (5956): No heartbeat from core client for 30 sec - exiting 19:51:48 (5956): No heartbeat from core client for 30 sec - exiting 19:51:49 (5956): No heartbeat from core client for 30 sec - exiting 19:51:50 (5956): No heartbeat from core client for 30 sec - exiting 19:51:51 (5956): No heartbeat from core client for 30 sec - exiting 19:51:52 (5956): No heartbeat from core client for 30 sec - exiting 19:51:53 (5956): No heartbeat from core client for 30 sec - exiting 19:51:54 (5956): No heartbeat from core client for 30 sec - exiting 19:51:56 (5956): No heartbeat from core client for 30 sec - exiting 19:51:57 (5956): No heartbeat from core client for 30 sec - exiting 19:51:58 (5956): No heartbeat from core client for 30 sec - exiting 19:51:59 (5956): No heartbeat from core client for 30 sec - exiting 19:52:00 (5956): No heartbeat from core client for 30 sec - exiting 19:52:01 (5956): No heartbeat from core client for 30 sec - exiting 19:52:02 (5956): No heartbeat from core client for 30 sec - exiting 19:52:03 (5956): No heartbeat from core client for 30 sec - exiting 19:52:04 (5956): No heartbeat from core client for 30 sec - exiting 19:52:05 (5956): No heartbeat from core client for 30 sec - exiting 19:52:06 (5956): No heartbeat from core client for 30 sec - exiting 19:52:08 (5956): No heartbeat from core client for 30 sec - exiting 19:52:09 (5956): No heartbeat from core client for 30 sec - exiting 19:52:10 (5956): No heartbeat from core client for 30 sec - exiting 19:52:11 (5956): No heartbeat from core client for 30 sec - exiting 19:52:12 (5956): No heartbeat from core client for 30 sec - exiting 19:52:13 (5956): No heartbeat from core client for 30 sec - exiting 19:52:14 (5956): No heartbeat from core client for 30 sec - exiting 19:52:15 (5956): No heartbeat from core client for 30 sec - exiting 19:52:16 (5956): No heartbeat from core client for 30 sec - exiting 19:52:17 (5956): No heartbeat from core client for 30 sec - exiting 19:52:18 (5956): No heartbeat from core client for 30 sec - exiting 19:52:19 (5956): No heartbeat from core client for 30 sec - exiting 19:52:20 (5956): No heartbeat from core client for 30 sec - exiting 19:52:21 (5956): No heartbeat from core client for 30 sec - exiting 19:52:22 (5956): No heartbeat from core client for 30 sec - exiting 19:52:23 (5956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2452, selfPID=2452, iMonCtr=2 20:10:55 (6532): No heartbeat from core client for 30 sec - exiting 20:10:56 (6532): No heartbeat from core client for 30 sec - exiting 20:10:58 (6532): No heartbeat from core client for 30 sec - exiting 20:10:59 (6532): No heartbeat from core client for 30 sec - exiting 20:11:00 (6532): No heartbeat from core client for 30 sec - exiting 20:11:01 (6532): No heartbeat from core client for 30 sec - exiting 20:11:02 (6532): No heartbeat from core client for 30 sec - exiting 20:11:03 (6532): No heartbeat from core client for 30 sec - exiting 20:11:04 (6532): No heartbeat from core client for 30 sec - exiting 20:11:05 (6532): No heartbeat from core client for 30 sec - exiting 20:11:06 (6532): No heartbeat from core client for 30 sec - exiting 20:11:07 (6532): No heartbeat from core client for 30 sec - exiting 20:11:08 (6532): No heartbeat from core client for 30 sec - exiting 20:11:10 (6532): No heartbeat from core client for 30 sec - exiting 20:11:11 (6532): No heartbeat from core client for 30 sec - exiting 20:11:12 (6532): No heartbeat from core client for 30 sec - exiting 20:11:13 (6532): No heartbeat from core client for 30 sec - exiting 20:11:14 (6532): No heartbeat from core client for 30 sec - exiting 20:11:15 (6532): No heartbeat from core client for 30 sec - exiting 20:11:16 (6532): No heartbeat from core client for 30 sec - exiting 20:11:17 (6532): No heartbeat from core client for 30 sec - exiting 20:11:18 (6532): No heartbeat from core client for 30 sec - exiting 20:11:19 (6532): No heartbeat from core client for 30 sec - exiting 20:11:20 (6532): No heartbeat from core client for 30 sec - exiting 20:11:22 (6532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5900, selfPID=5900, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=5152, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3872, selfPID=1924, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_e1hr_2013_1_009758646_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e1hr_2013_1_009758646_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e1hr_2013_1_009758646_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e1hr_2013_1_009758646_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e1hr_2013_1_009758646_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e1hr_2013_1_009758646_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Apr 2015 21:16:08	994306	18332322	hadam3p_anz_e1hr_2013_1_009758646_0	69,419	197,886	2.8506
26 Apr 2015 19:06:33	994306	18332322	hadam3p_anz_e1hr_2013_1_009758646_0	57,899	163,457	2.8231
26 Apr 2015 09:32:47	994306	18332322	hadam3p_anz_e1hr_2013_1_009758646_0	46,379	129,451	2.7912
25 Apr 2015 15:12:53	994306	18332322	hadam3p_anz_e1hr_2013_1_009758646_0	34,859	96,753	2.7756
25 Apr 2015 06:45:05	994306	18332322	hadam3p_anz_e1hr_2013_1_009758646_0	23,339	66,221	2.8374
22 Apr 2015 19:52:53	994306	18332322	hadam3p_anz_e1hr_2013_1_009758646_0	11,819	33,702	2.8515