Task 18661642

Name	hadam3p_anz_u23x_2013_1_010000429_0
Workunit	9998787
Created	3 Jul 2015, 10:31:14 UTC
Sent	5 Jul 2015, 3:26:15 UTC
Report deadline	16 Jun 2016, 8:46:15 UTC
Received	10 Jul 2015, 0:07:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1367813
Run time	2 days 0 hours 49 min 21 sec
CPU time	1 days 22 hours 35 min 31 sec
Validate state	Invalid
Credit	509.72
Device peak FLOPS	1.69 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:36:18 (3556): No heartbeat from core client for 30 sec - exiting 19:36:19 (3556): No heartbeat from core client for 30 sec - exiting 19:36:20 (3556): No heartbeat from core client for 30 sec - exiting 19:36:21 (3556): No heartbeat from core client for 30 sec - exiting 19:36:22 (3556): No heartbeat from core client for 30 sec - exiting 19:36:23 (3556): No heartbeat from core client for 30 sec - exiting 19:36:24 (3556): No heartbeat from core client for 30 sec - exiting 19:36:25 (3556): No heartbeat from core client for 30 sec - exiting 19:36:26 (3556): No heartbeat from core client for 30 sec - exiting 19:36:27 (3556): No heartbeat from core client for 30 sec - exiting 19:36:28 (3556): No heartbeat from core client for 30 sec - exiting 19:36:29 (3556): No heartbeat from core client for 30 sec - exiting 19:36:30 (3556): No heartbeat from core client for 30 sec - exiting 19:36:31 (3556): No heartbeat from core client for 30 sec - exiting 19:36:32 (3556): No heartbeat from core client for 30 sec - exiting 19:36:33 (3556): No heartbeat from core client for 30 sec - exiting 19:36:34 (3556): No heartbeat from core client for 30 sec - exiting 19:36:35 (3556): No heartbeat from core client for 30 sec - exiting 19:36:36 (3556): No heartbeat from core client for 30 sec - exiting 19:36:37 (3556): No heartbeat from core client for 30 sec - exiting 19:36:38 (3556): No heartbeat from core client for 30 sec - exiting 19:36:39 (3556): No heartbeat from core client for 30 sec - exiting 19:36:40 (3556): No heartbeat from core client for 30 sec - exiting 19:36:41 (3556): No heartbeat from core client for 30 sec - exiting 19:36:42 (3556): No heartbeat from core client for 30 sec - exiting 19:36:43 (3556): No heartbeat from core client for 30 sec - exiting 19:36:44 (3556): No heartbeat from core client for 30 sec - exiting 19:36:45 (3556): No heartbeat from core client for 30 sec - exiting 19:36:46 (3556): No heartbeat from core client for 30 sec - exiting 19:36:47 (3556): No heartbeat from core client for 30 sec - exiting 19:36:48 (3556): No heartbeat from core client for 30 sec - exiting 19:36:49 (3556): No heartbeat from core client for 30 sec - exiting 19:36:50 (3556): No heartbeat from core client for 30 sec - exiting 19:36:51 (3556): No heartbeat from core client for 30 sec - exiting 19:36:52 (3556): No heartbeat from core client for 30 sec - exiting 19:36:53 (3556): No heartbeat from core client for 30 sec - exiting 19:36:54 (3556): No heartbeat from core client for 30 sec - exiting 19:36:55 (3556): No heartbeat from core client for 30 sec - exiting 19:36:56 (3556): No heartbeat from core client for 30 sec - exiting 19:36:57 (3556): No heartbeat from core client for 30 sec - exiting 19:36:58 (3556): No heartbeat from core client for 30 sec - exiting 19:36:59 (3556): No heartbeat from core client for 30 sec - exiting 19:37:00 (3556): No heartbeat from core client for 30 sec - exiting 19:37:01 (3556): No heartbeat from core client for 30 sec - exiting 19:37:02 (3556): No heartbeat from core client for 30 sec - exiting 19:37:03 (3556): No heartbeat from core client for 30 sec - exiting 19:37:04 (3556): No heartbeat from core client for 30 sec - exiting 19:37:05 (3556): No heartbeat from core client for 30 sec - exiting 19:37:06 (3556): No heartbeat from core client for 30 sec - exiting 19:37:07 (3556): No heartbeat from core client for 30 sec - exiting 19:37:08 (3556): No heartbeat from core client for 30 sec - exiting 19:37:09 (3556): No heartbeat from core client for 30 sec - exiting 19:37:10 (3556): No heartbeat from core client for 30 sec - exiting 19:37:11 (3556): No heartbeat from core client for 30 sec - exiting 19:37:12 (3556): No heartbeat from core client for 30 sec - exiting 19:37:13 (3556): No heartbeat from core client for 30 sec - exiting 19:37:14 (3556): No heartbeat from core client for 30 sec - exiting 19:37:15 (3556): No heartbeat from core client for 30 sec - exiting 19:37:16 (3556): No heartbeat from core client for 30 sec - exiting 19:37:17 (3556): No heartbeat from core client for 30 sec - exiting 19:37:18 (3556): No heartbeat from core client for 30 sec - exiting 19:37:19 (3556): No heartbeat from core client for 30 sec - exiting 19:37:20 (3556): No heartbeat from core client for 30 sec - exiting 19:37:21 (3556): No heartbeat from core client for 30 sec - exiting 19:37:22 (3556): No heartbeat from core client for 30 sec - exiting 19:37:23 (3556): No heartbeat from core client for 30 sec - exiting 19:37:24 (3556): No heartbeat from core client for 30 sec - exiting 19:37:25 (3556): No heartbeat from core client for 30 sec - exiting 19:37:26 (3556): No heartbeat from core client for 30 sec - exiting 19:37:27 (3556): No heartbeat from core client for 30 sec - exiting 19:37:28 (3556): No heartbeat from core client for 30 sec - exiting 19:37:29 (3556): No heartbeat from core client for 30 sec - exiting 19:37:30 (3556): No heartbeat from core client for 30 sec - exiting 19:37:31 (3556): No heartbeat from core client for 30 sec - exiting 19:37:32 (3556): No heartbeat from core client for 30 sec - exiting 19:37:33 (3556): No heartbeat from core client for 30 sec - exiting 19:37:34 (3556): No heartbeat from core client for 30 sec - exiting 19:37:35 (3556): No heartbeat from core client for 30 sec - exiting 19:37:36 (3556): No heartbeat from core client for 30 sec - exiting 19:37:37 (3556): No heartbeat from core client for 30 sec - exiting 19:37:38 (3556): No heartbeat from core client for 30 sec - exiting 19:37:39 (3556): No heartbeat from core client for 30 sec - exiting 19:37:40 (3556): No heartbeat from core client for 30 sec - exiting 19:37:41 (3556): No heartbeat from core client for 30 sec - exiting 19:37:42 (3556): No heartbeat from core client for 30 sec - exiting 19:37:43 (3556): No heartbeat from core client for 30 sec - exiting 19:37:44 (3556): No heartbeat from core client for 30 sec - exiting 19:37:45 (3556): No heartbeat from core client for 30 sec - exiting 19:37:46 (3556): No heartbeat from core client for 30 sec - exiting 19:37:47 (3556): No heartbeat from core client for 30 sec - exiting 19:37:48 (3556): No heartbeat from core client for 30 sec - exiting 19:37:49 (3556): No heartbeat from core client for 30 sec - exiting 19:37:50 (3556): No heartbeat from core client for 30 sec - exiting 19:37:51 (3556): No heartbeat from core client for 30 sec - exiting 19:37:52 (3556): No heartbeat from core client for 30 sec - exiting 19:37:53 (3556): No heartbeat from core client for 30 sec - exiting 19:37:54 (3556): No heartbeat from core client for 30 sec - exiting 19:37:55 (3556): No heartbeat from core client for 30 sec - exiting 19:37:56 (3556): No heartbeat from core client for 30 sec - exiting 19:37:57 (3556): No heartbeat from core client for 30 sec - exiting 19:37:58 (3556): No heartbeat from core client for 30 sec - exiting 19:37:59 (3556): No heartbeat from core client for 30 sec - exiting 19:38:00 (3556): No heartbeat from core client for 30 sec - exiting 19:38:01 (3556): No heartbeat from core client for 30 sec - exiting 19:38:02 (3556): No heartbeat from core client for 30 sec - exiting 19:38:03 (3556): No heartbeat from core client for 30 sec - exiting 19:38:04 (3556): No heartbeat from core client for 30 sec - exiting 19:38:05 (3556): No heartbeat from core client for 30 sec - exiting 19:38:06 (3556): No heartbeat from core client for 30 sec - exiting 19:38:07 (3556): No heartbeat from core client for 30 sec - exiting 19:38:08 (3556): No heartbeat from core client for 30 sec - exiting 19:38:09 (3556): No heartbeat from core client for 30 sec - exiting 19:38:10 (3556): No heartbeat from core client for 30 sec - exiting 19:38:11 (3556): No heartbeat from core client for 30 sec - exiting 19:38:12 (3556): No heartbeat from core client for 30 sec - exiting 19:38:13 (3556): No heartbeat from core client for 30 sec - exiting 19:38:14 (3556): No heartbeat from core client for 30 sec - exiting 19:38:15 (3556): No heartbeat from core client for 30 sec - exiting 19:38:16 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5392, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5632, selfPID=4816, iMonCtr=1 Model crash detected, will try to restart... 09:03:11 (3952): No heartbeat from core client for 30 sec - exiting 09:03:12 (3952): No heartbeat from core client for 30 sec - exiting 09:03:13 (3952): No heartbeat from core client for 30 sec - exiting 09:03:14 (3952): No heartbeat from core client for 30 sec - exiting 09:03:15 (3952): No heartbeat from core client for 30 sec - exiting 09:03:16 (3952): No heartbeat from core client for 30 sec - exiting 09:03:17 (3952): No heartbeat from core client for 30 sec - exiting 09:03:18 (3952): No heartbeat from core client for 30 sec - exiting 09:03:19 (3952): No heartbeat from core client for 30 sec - exiting 09:03:20 (3952): No heartbeat from core client for 30 sec - exiting 09:03:21 (3952): No heartbeat from core client for 30 sec - exiting 09:03:22 (3952): No heartbeat from core client for 30 sec - exiting 09:03:23 (3952): No heartbeat from core client for 30 sec - exiting 09:03:24 (3952): No heartbeat from core client for 30 sec - exiting 09:03:25 (3952): No heartbeat from core client for 30 sec - exiting 09:03:26 (3952): No heartbeat from core client for 30 sec - exiting 09:03:27 (3952): No heartbeat from core client for 30 sec - exiting 09:03:28 (3952): No heartbeat from core client for 30 sec - exiting 09:03:29 (3952): No heartbeat from core client for 30 sec - exiting 09:03:30 (3952): No heartbeat from core client for 30 sec - exiting 09:03:31 (3952): No heartbeat from core client for 30 sec - exiting 09:03:32 (3952): No heartbeat from core client for 30 sec - exiting 09:03:33 (3952): No heartbeat from core client for 30 sec - exiting 09:03:34 (3952): No heartbeat from core client for 30 sec - exiting 09:03:35 (3952): No heartbeat from core client for 30 sec - exiting 09:03:36 (3952): No heartbeat from core client for 30 sec - exiting 09:03:37 (3952): No heartbeat from core client for 30 sec - exiting 09:03:38 (3952): No heartbeat from core client for 30 sec - exiting 09:03:39 (3952): No heartbeat from core client for 30 sec - exiting 09:03:40 (3952): No heartbeat from core client for 30 sec - exiting 09:03:41 (3952): No heartbeat from core client for 30 sec - exiting 09:03:42 (3952): No heartbeat from core client for 30 sec - exiting 09:03:43 (3952): No heartbeat from core client for 30 sec - exiting 09:03:44 (3952): No heartbeat from core client for 30 sec - exiting 09:03:45 (3952): No heartbeat from core client for 30 sec - exiting 09:03:46 (3952): No heartbeat from core client for 30 sec - exiting 09:03:47 (3952): No heartbeat from core client for 30 sec - exiting 09:03:48 (3952): No heartbeat from core client for 30 sec - exiting 09:03:49 (3952): No heartbeat from core client for 30 sec - exiting 09:03:50 (3952): No heartbeat from core client for 30 sec - exiting 09:03:51 (3952): No heartbeat from core client for 30 sec - exiting 09:03:52 (3952): No heartbeat from core client for 30 sec - exiting 09:03:53 (3952): No heartbeat from core client for 30 sec - exiting 09:03:54 (3952): No heartbeat from core client for 30 sec - exiting 09:03:55 (3952): No heartbeat from core client for 30 sec - exiting 09:03:56 (3952): No heartbeat from core client for 30 sec - exiting 09:03:57 (3952): No heartbeat from core client for 30 sec - exiting 09:03:58 (3952): No heartbeat from core client for 30 sec - exiting 09:03:59 (3952): No heartbeat from core client for 30 sec - exiting 09:04:00 (3952): No heartbeat from core client for 30 sec - exiting 09:04:01 (3952): No heartbeat from core client for 30 sec - exiting 09:04:02 (3952): No heartbeat from core client for 30 sec - exiting 09:04:03 (3952): No heartbeat from core client for 30 sec - exiting 09:04:04 (3952): No heartbeat from core client for 30 sec - exiting 09:04:05 (3952): No heartbeat from core client for 30 sec - exiting 09:04:06 (3952): No heartbeat from core client for 30 sec - exiting 09:04:07 (3952): No heartbeat from core client for 30 sec - exiting 09:04:08 (3952): No heartbeat from core client for 30 sec - exiting 09:04:09 (3952): No heartbeat from core client for 30 sec - exiting 09:04:10 (3952): No heartbeat from core client for 30 sec - exiting 09:04:11 (3952): No heartbeat from core client for 30 sec - exiting 09:04:12 (3952): No heartbeat from core client for 30 sec - exiting 09:04:13 (3952): No heartbeat from core client for 30 sec - exiting 09:04:14 (3952): No heartbeat from core client for 30 sec - exiting 09:04:15 (3952): No heartbeat from core client for 30 sec - exiting 09:04:16 (3952): No heartbeat from core client for 30 sec - exiting 09:04:17 (3952): No heartbeat from core client for 30 sec - exiting 09:04:18 (3952): No heartbeat from core client for 30 sec - exiting 09:04:19 (3952): No heartbeat from core client for 30 sec - exiting 09:04:20 (3952): No heartbeat from core client for 30 sec - exiting 09:04:21 (3952): No heartbeat from core client for 30 sec - exiting 09:04:22 (3952): No heartbeat from core client for 30 sec - exiting 09:04:23 (3952): No heartbeat from core client for 30 sec - exiting 09:04:24 (3952): No heartbeat from core client for 30 sec - exiting 09:04:25 (3952): No heartbeat from core client for 30 sec - exiting 09:04:26 (3952): No heartbeat from core client for 30 sec - exiting 09:04:27 (3952): No heartbeat from core client for 30 sec - exiting 09:04:28 (3952): No heartbeat from core client for 30 sec - exiting 09:04:29 (3952): No heartbeat from core client for 30 sec - exiting 09:04:30 (3952): No heartbeat from core client for 30 sec - exiting 09:04:31 (3952): No heartbeat from core client for 30 sec - exiting 09:04:32 (3952): No heartbeat from core client for 30 sec - exiting 09:04:33 (3952): No heartbeat from core client for 30 sec - exiting 09:04:34 (3952): No heartbeat from core client for 30 sec - exiting 09:04:35 (3952): No heartbeat from core client for 30 sec - exiting 09:04:36 (3952): No heartbeat from core client for 30 sec - exiting 09:04:37 (3952): No heartbeat from core client for 30 sec - exiting 09:04:38 (3952): No heartbeat from core client for 30 sec - exiting 09:04:39 (3952): No heartbeat from core client for 30 sec - exiting 09:04:40 (3952): No heartbeat from core client for 30 sec - exiting 09:04:41 (3952): No heartbeat from core client for 30 sec - exiting 09:04:42 (3952): No heartbeat from core client for 30 sec - exiting 09:04:43 (3952): No heartbeat from core client for 30 sec - exiting 09:04:44 (3952): No heartbeat from core client for 30 sec - exiting 09:04:45 (3952): No heartbeat from core client for 30 sec - exiting 09:04:46 (3952): No heartbeat from core client for 30 sec - exiting 09:04:47 (3952): No heartbeat from core client for 30 sec - exiting 09:04:48 (3952): No heartbeat from core client for 30 sec - exiting 09:04:49 (3952): No heartbeat from core client for 30 sec - exiting 09:04:50 (3952): No heartbeat from core client for 30 sec - exiting 09:04:51 (3952): No heartbeat from core client for 30 sec - exiting 09:04:52 (3952): No heartbeat from core client for 30 sec - exiting 09:04:53 (3952): No heartbeat from core client for 30 sec - exiting 09:04:54 (3952): No heartbeat from core client for 30 sec - exiting 09:04:55 (3952): No heartbeat from core client for 30 sec - exiting 09:04:56 (3952): No heartbeat from core client for 30 sec - exiting 09:04:57 (3952): No heartbeat from core client for 30 sec - exiting 09:04:58 (3952): No heartbeat from core client for 30 sec - exiting 09:04:59 (3952): No heartbeat from core client for 30 sec - exiting 09:05:00 (3952): No heartbeat from core client for 30 sec - exiting 09:05:01 (3952): No heartbeat from core client for 30 sec - exiting 09:05:02 (3952): No heartbeat from core client for 30 sec - exiting 09:05:03 (3952): No heartbeat from core client for 30 sec - exiting 09:05:04 (3952): No heartbeat from core client for 30 sec - exiting 09:05:05 (3952): No heartbeat from core client for 30 sec - exiting 09:05:06 (3952): No heartbeat from core client for 30 sec - exiting 09:05:07 (3952): No heartbeat from core client for 30 sec - exiting 09:05:08 (3952): No heartbeat from core client for 30 sec - exiting 09:05:09 (3952): No heartbeat from core client for 30 sec - exiting 09:05:10 (3952): No heartbeat from core client for 30 sec - exiting 09:05:11 (3952): No heartbeat from core client for 30 sec - exiting 09:05:12 (3952): No heartbeat from core client for 30 sec - exiting 09:05:13 (3952): No heartbeat from core client for 30 sec - exiting 09:05:14 (3952): No heartbeat from core client for 30 sec - exiting 09:05:15 (3952): No heartbeat from core client for 30 sec - exiting 09:05:16 (3952): No heartbeat from core client for 30 sec - exiting 09:05:17 (3952): No heartbeat from core client for 30 sec - exiting 09:05:18 (3952): No heartbeat from core client for 30 sec - exiting 09:05:19 (3952): No heartbeat from core client for 30 sec - exiting 09:05:20 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5344, iMonCtr=2 Model crash detected, will try to restart... 12:07:08 (3636): No heartbeat from core client for 30 sec - exiting 12:07:09 (3636): No heartbeat from core client for 30 sec - exiting 12:07:10 (3636): No heartbeat from core client for 30 sec - exiting 12:07:11 (3636): No heartbeat from core client for 30 sec - exiting 12:07:12 (3636): No heartbeat from core client for 30 sec - exiting 12:07:13 (3636): No heartbeat from core client for 30 sec - exiting 12:07:14 (3636): No heartbeat from core client for 30 sec - exiting 12:07:15 (3636): No heartbeat from core client for 30 sec - exiting 12:07:16 (3636): No heartbeat from core client for 30 sec - exiting 12:07:17 (3636): No heartbeat from core client for 30 sec - exiting 12:07:18 (3636): No heartbeat from core client for 30 sec - exiting 12:07:19 (3636): No heartbeat from core client for 30 sec - exiting 12:07:20 (3636): No heartbeat from core client for 30 sec - exiting 12:07:21 (3636): No heartbeat from core client for 30 sec - exiting 12:07:22 (3636): No heartbeat from core client for 30 sec - exiting 12:07:23 (3636): No heartbeat from core client for 30 sec - exiting 12:07:24 (3636): No heartbeat from core client for 30 sec - exiting 12:07:25 (3636): No heartbeat from core client for 30 sec - exiting 12:07:26 (3636): No heartbeat from core client for 30 sec - exiting 12:07:27 (3636): No heartbeat from core client for 30 sec - exiting 12:07:28 (3636): No heartbeat from core client for 30 sec - exiting 12:07:29 (3636): No heartbeat from core client for 30 sec - exiting 12:07:30 (3636): No heartbeat from core client for 30 sec - exiting 12:07:31 (3636): No heartbeat from core client for 30 sec - exiting 12:07:32 (3636): No heartbeat from core client for 30 sec - exiting 12:07:33 (3636): No heartbeat from core client for 30 sec - exiting 12:07:34 (3636): No heartbeat from core client for 30 sec - exiting 12:07:35 (3636): No heartbeat from core client for 30 sec - exiting 12:07:36 (3636): No heartbeat from core client for 30 sec - exiting 12:07:37 (3636): No heartbeat from core client for 30 sec - exiting 12:07:38 (3636): No heartbeat from core client for 30 sec - exiting 12:07:39 (3636): No heartbeat from core client for 30 sec - exiting 12:07:40 (3636): No heartbeat from core client for 30 sec - exiting 12:07:41 (3636): No heartbeat from core client for 30 sec - exiting 12:07:42 (3636): No heartbeat from core client for 30 sec - exiting 12:07:43 (3636): No heartbeat from core client for 30 sec - exiting 12:07:44 (3636): No heartbeat from core client for 30 sec - exiting 12:07:45 (3636): No heartbeat from core client for 30 sec - exiting 12:07:46 (3636): No heartbeat from core client for 30 sec - exiting 12:07:47 (3636): No heartbeat from core client for 30 sec - exiting 12:07:48 (3636): No heartbeat from core client for 30 sec - exiting 12:07:49 (3636): No heartbeat from core client for 30 sec - exiting 12:07:50 (3636): No heartbeat from core client for 30 sec - exiting 12:07:51 (3636): No heartbeat from core client for 30 sec - exiting 12:07:52 (3636): No heartbeat from core client for 30 sec - exiting 12:07:53 (3636): No heartbeat from core client for 30 sec - exiting 12:07:54 (3636): No heartbeat from core client for 30 sec - exiting 12:07:55 (3636): No heartbeat from core client for 30 sec - exiting 12:07:56 (3636): No heartbeat from core client for 30 sec - exiting 12:07:57 (3636): No heartbeat from core client for 30 sec - exiting 12:07:58 (3636): No heartbeat from core client for 30 sec - exiting 12:07:59 (3636): No heartbeat from core client for 30 sec - exiting 12:08:00 (3636): No heartbeat from core client for 30 sec - exiting 12:08:01 (3636): No heartbeat from core client for 30 sec - exiting 12:08:02 (3636): No heartbeat from core client for 30 sec - exiting 12:08:03 (3636): No heartbeat from core client for 30 sec - exiting 12:08:04 (3636): No heartbeat from core client for 30 sec - exiting 12:08:05 (3636): No heartbeat from core client for 30 sec - exiting 12:08:06 (3636): No heartbeat from core client for 30 sec - exiting 12:08:07 (3636): No heartbeat from core client for 30 sec - exiting 12:08:08 (3636): No heartbeat from core client for 30 sec - exiting 12:08:09 (3636): No heartbeat from core client for 30 sec - exiting 12:08:10 (3636): No heartbeat from core client for 30 sec - exiting 12:08:11 (3636): No heartbeat from core client for 30 sec - exiting 12:08:12 (3636): No heartbeat from core client for 30 sec - exiting 12:08:13 (3636): No heartbeat from core client for 30 sec - exiting 12:08:14 (3636): No heartbeat from core client for 30 sec - exiting 12:08:15 (3636): No heartbeat from core client for 30 sec - exiting 12:08:16 (3636): No heartbeat from core client for 30 sec - exiting 12:08:17 (3636): No heartbeat from core client for 30 sec - exiting 12:08:18 (3636): No heartbeat from core client for 30 sec - exiting 12:08:19 (3636): No heartbeat from core client for 30 sec - exiting 12:08:20 (3636): No heartbeat from core client for 30 sec - exiting 12:08:21 (3636): No heartbeat from core client for 30 sec - exiting 12:08:22 (3636): No heartbeat from core client for 30 sec - exiting 12:08:23 (3636): No heartbeat from core client for 30 sec - exiting 12:08:24 (3636): No heartbeat from core client for 30 sec - exiting 12:08:25 (3636): No heartbeat from core client for 30 sec - exiting 12:08:26 (3636): No heartbeat from core client for 30 sec - exiting 12:08:27 (3636): No heartbeat from core client for 30 sec - exiting 12:08:28 (3636): No heartbeat from core client for 30 sec - exiting 12:08:29 (3636): No heartbeat from core client for 30 sec - exiting 12:08:30 (3636): No heartbeat from core client for 30 sec - exiting 12:08:31 (3636): No heartbeat from core client for 30 sec - exiting 12:08:32 (3636): No heartbeat from core client for 30 sec - exiting 12:08:33 (3636): No heartbeat from core client for 30 sec - exiting 12:08:34 (3636): No heartbeat from core client for 30 sec - exiting 12:08:35 (3636): No heartbeat from core client for 30 sec - exiting 12:08:36 (3636): No heartbeat from core client for 30 sec - exiting 12:08:37 (3636): No heartbeat from core client for 30 sec - exiting 12:08:38 (3636): No heartbeat from core client for 30 sec - exiting 12:08:39 (3636): No heartbeat from core client for 30 sec - exiting 12:08:40 (3636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2612, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4192, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3272, iMonCtr=2 Leaving CPDN_Main::Monitor... </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_u23x_2013_1_010000429_0_2.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_u23x_2013_1_010000429_0_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_u23x_2013_1_010000429_0_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_u23x_2013_1_010000429_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_u23x_2013_1_010000429_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_u23x_2013_1_010000429_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_u23x_2013_1_010000429_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_u23x_2013_1_010000429_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_u23x_2013_1_010000429_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_u23x_2013_1_010000429_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_u23x_2013_1_010000429_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Jul 2015 02:34:39	1367813	18661642	hadam3p_anz_u23x_2013_1_010000429_0	11,819	119,483	10.1094