Task 16026042

Name	hadcm3n_857a_1980_40_008464698_0
Workunit	8615537
Created	19 Sep 2013, 14:44:10 UTC
Sent	20 Sep 2013, 14:13:38 UTC
Report deadline	20 Dec 2013, 21:40:49 UTC
Received	26 Sep 2013, 6:36:19 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1158872
Run time	4 days 1 hours 34 min 33 sec
CPU time	3 days 21 hours 22 min 45 sec
Validate state	Invalid
Credit	1,244.16
Device peak FLOPS	1.53 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 16:23:05 (10772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:10 (8744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:14 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:33:34 (10912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:41 (4656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:42 (4656): No heartbeat from core client for 30 sec - exiting 04:33:43 (5348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:43:17 (8312): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:02:28 (2176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:51 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:52 (5008): No heartbeat from core client for 30 sec - exiting 19:27:54 (5008): No heartbeat from core client for 30 sec - exiting 19:27:55 (5008): No heartbeat from core client for 30 sec - exiting 19:58:17 (10740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:21 (8384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:05 (9692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:40 (2020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:31 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:44:39 (10444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:46:21 (552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:55:17 (3460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:42 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:17:07 (11524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:50 (11620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:47 (5944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:57:46 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:55:23 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:55:46 (5340): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:14:37 (3264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:45:38 (11268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:08:37 (8132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:42 (8336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:42 (11412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:48:33 (7416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:54:28 (7268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:38:44 (11308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:45 (11308): No heartbeat from core client for 30 sec - exiting 07:40:05 (8488): No heartbeat from core client for 30 sec - exiting 07:40:06 (8488): No heartbeat from core client for 30 sec - exiting 07:40:07 (8488): No heartbeat from core client for 30 sec - exiting 07:40:08 (8488): No heartbeat from core client for 30 sec - exiting 07:40:09 (8488): No heartbeat from core client for 30 sec - exiting 07:40:10 (8488): No heartbeat from core client for 30 sec - exiting 07:40:11 (8488): No heartbeat from core client for 30 sec - exiting 07:40:12 (8488): No heartbeat from core client for 30 sec - exiting 07:40:13 (8488): No heartbeat from core client for 30 sec - exiting 07:40:14 (8488): No heartbeat from core client for 30 sec - exiting 07:40:16 (8488): No heartbeat from core client for 30 sec - exiting 07:40:17 (8488): No heartbeat from core client for 30 sec - exiting 07:40:18 (8488): No heartbeat from core client for 30 sec - exiting 07:40:19 (8488): No heartbeat from core client for 30 sec - exiting 07:40:20 (8488): No heartbeat from core client for 30 sec - exiting 07:40:21 (8488): No heartbeat from core client for 30 sec - exiting 07:40:22 (8488): No heartbeat from core client for 30 sec - exiting 07:40:23 (8488): No heartbeat from core client for 30 sec - exiting 07:40:24 (8488): No heartbeat from core client for 30 sec - exiting 07:40:25 (8488): No heartbeat from core client for 30 sec - exiting 07:40:26 (8488): No heartbeat from core client for 30 sec - exiting 07:40:27 (8488): No heartbeat from core client for 30 sec - exiting 07:40:28 (8488): No heartbeat from core client for 30 sec - exiting 07:40:29 (8488): No heartbeat from core client for 30 sec - exiting 07:40:30 (8488): No heartbeat from core client for 30 sec - exiting 07:40:31 (8488): No heartbeat from core client for 30 sec - exiting 07:40:32 (8488): No heartbeat from core client for 30 sec - exiting 07:40:33 (8488): No heartbeat from core client for 30 sec - exiting 07:40:34 (8488): No heartbeat from core client for 30 sec - exiting 07:40:35 (8488): No heartbeat from core client for 30 sec - exiting 07:40:36 (8488): No heartbeat from core client for 30 sec - exiting 07:40:37 (8488): No heartbeat from core client for 30 sec - exiting 07:40:38 (8488): No heartbeat from core client for 30 sec - exiting 07:40:39 (8488): No heartbeat from core client for 30 sec - exiting 07:40:40 (8488): No heartbeat from core client for 30 sec - exiting 07:40:41 (8488): No heartbeat from core client for 30 sec - exiting 07:40:42 (8488): No heartbeat from core client for 30 sec - exiting 07:40:43 (8488): No heartbeat from core client for 30 sec - exiting 07:40:44 (8488): No heartbeat from core client for 30 sec - exiting 07:40:45 (8488): No heartbeat from core client for 30 sec - exiting 07:40:46 (8488): No heartbeat from core client for 30 sec - exiting 07:40:47 (8488): No heartbeat from core client for 30 sec - exiting 07:40:48 (8488): No heartbeat from core client for 30 sec - exiting 07:40:49 (8488): No heartbeat from core client for 30 sec - exiting 07:40:50 (8488): No heartbeat from core client for 30 sec - exiting 07:40:51 (8488): No heartbeat from core client for 30 sec - exiting 07:40:52 (8488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:42 (7036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:42 (888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:07:26 (3104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:44 (6496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:18 (9240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:35:53 (9980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:10:26 (6412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:50:25 (3364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:51:38 (9372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:50:33 (3392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:34 (8832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:10:34 (11476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:34 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:35 (3196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:20:37 (8184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:50:39 (6808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:41 (2164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:00:43 (11012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:43 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:44 (6712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:56 (8240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:51 (9948): No heartbeat from core client for 30 sec - exiting 19:43:52 (9948): No heartbeat from core client for 30 sec - exiting 19:43:53 (9948): No heartbeat from core client for 30 sec - exiting 19:43:54 (9948): No heartbeat from core client for 30 sec - exiting 19:43:55 (9948): No heartbeat from core client for 30 sec - exiting 19:43:56 (9948): No heartbeat from core client for 30 sec - exiting 19:43:57 (9948): No heartbeat from core client for 30 sec - exiting 19:43:59 (9948): No heartbeat from core client for 30 sec - exiting 19:44:00 (9948): No heartbeat from core client for 30 sec - exiting 19:44:01 (9948): No heartbeat from core client for 30 sec - exiting 19:44:02 (9948): No heartbeat from core client for 30 sec - exiting 19:44:03 (9948): No heartbeat from core client for 30 sec - exiting 19:44:04 (9948): No heartbeat from core client for 30 sec - exiting 19:44:05 (9948): No heartbeat from core client for 30 sec - exiting 19:44:06 (9948): No heartbeat from core client for 30 sec - exiting 19:44:07 (9948): No heartbeat from core client for 30 sec - exiting 19:44:08 (9948): No heartbeat from core client for 30 sec - exiting 19:44:09 (9948): No heartbeat from core client for 30 sec - exiting 19:44:11 (9948): No heartbeat from core client for 30 sec - exiting 19:44:12 (9948): No heartbeat from core client for 30 sec - exiting 19:44:13 (9948): No heartbeat from core client for 30 sec - exiting 19:44:14 (9948): No heartbeat from core client for 30 sec - exiting 19:44:15 (9948): No heartbeat from core client for 30 sec - exiting 19:44:16 (9948): No heartbeat from core client for 30 sec - exiting 19:44:17 (9948): No heartbeat from core client for 30 sec - exiting 19:44:18 (9948): No heartbeat from core client for 30 sec - exiting 19:44:19 (9948): No heartbeat from core client for 30 sec - exiting 19:44:20 (9948): No heartbeat from core client for 30 sec - exiting 19:44:21 (9948): No heartbeat from core client for 30 sec - exiting 19:44:23 (9948): No heartbeat from core client for 30 sec - exiting 19:44:24 (9948): No heartbeat from core client for 30 sec - exiting 19:44:25 (9948): No heartbeat from core client for 30 sec - exiting 19:44:26 (9948): No heartbeat from core client for 30 sec - exiting 19:44:27 (9948): No heartbeat from core client for 30 sec - exiting 19:44:28 (9948): No heartbeat from core client for 30 sec - exiting 19:44:29 (9948): No heartbeat from core client for 30 sec - exiting 19:44:30 (9948): No heartbeat from core client for 30 sec - exiting 19:44:31 (9948): No heartbeat from core client for 30 sec - exiting 19:44:32 (9948): No heartbeat from core client for 30 sec - exiting 19:44:33 (9948): No heartbeat from core client for 30 sec - exiting 19:44:35 (9948): No heartbeat from core client for 30 sec - exiting 19:44:36 (9948): No heartbeat from core client for 30 sec - exiting 19:44:37 (9948): No heartbeat from core client for 30 sec - exiting 19:44:38 (9948): No heartbeat from core client for 30 sec - exiting 19:44:39 (9948): No heartbeat from core client for 30 sec - exiting 19:44:40 (9948): No heartbeat from core client for 30 sec - exiting 19:44:41 (9948): No heartbeat from core client for 30 sec - exiting 19:44:42 (9948): No heartbeat from core client for 30 sec - exiting 19:44:43 (9948): No heartbeat from core client for 30 sec - exiting 19:44:44 (9948): No heartbeat from core client for 30 sec - exiting 19:44:45 (9948): No heartbeat from core client for 30 sec - exiting 19:44:47 (9948): No heartbeat from core client for 30 sec - exiting 19:44:48 (9948): No heartbeat from core client for 30 sec - exiting 19:44:49 (9948): No heartbeat from core client for 30 sec - exiting 19:44:50 (9948): No heartbeat from core client for 30 sec - exiting 19:44:51 (9948): No heartbeat from core client for 30 sec - exiting 19:44:52 (9948): No heartbeat from core client for 30 sec - exiting 19:44:53 (9948): No heartbeat from core client for 30 sec - exiting 19:44:54 (9948): No heartbeat from core client for 30 sec - exiting 19:44:55 (9948): No heartbeat from core client for 30 sec - exiting 19:44:56 (9948): No heartbeat from core client for 30 sec - exiting 19:44:58 (9948): No heartbeat from core client for 30 sec - exiting 19:44:59 (9948): No heartbeat from core client for 30 sec - exiting 19:45:00 (9948): No heartbeat from core client for 30 sec - exiting 19:45:01 (9948): No heartbeat from core client for 30 sec - exiting 19:45:02 (9948): No heartbeat from core client for 30 sec - exiting 19:45:03 (9948): No heartbeat from core client for 30 sec - exiting 19:45:04 (9948): No heartbeat from core client for 30 sec - exiting 19:45:05 (9948): No heartbeat from core client for 30 sec - exiting 19:45:06 (9948): No heartbeat from core client for 30 sec - exiting 19:45:07 (9948): No heartbeat from core client for 30 sec - exiting 19:45:08 (9948): No heartbeat from core client for 30 sec - exiting 19:45:10 (9948): No heartbeat from core client for 30 sec - exiting 19:45:11 (9948): No heartbeat from core client for 30 sec - exiting 19:45:12 (9948): No heartbeat from core client for 30 sec - exiting 19:45:13 (9948): No heartbeat from core client for 30 sec - exiting 19:45:14 (9948): No heartbeat from core client for 30 sec - exiting 19:45:15 (9948): No heartbeat from core client for 30 sec - exiting 19:45:16 (9948): No heartbeat from core client for 30 sec - exiting 19:45:17 (9948): No heartbeat from core client for 30 sec - exiting 19:45:18 (9948): No heartbeat from core client for 30 sec - exiting 19:45:19 (9948): No heartbeat from core client for 30 sec - exiting 19:45:20 (9948): No heartbeat from core client for 30 sec - exiting 19:45:22 (9948): No heartbeat from core client for 30 sec - exiting 19:45:23 (9948): No heartbeat from core client for 30 sec - exiting 19:45:24 (9948): No heartbeat from core client for 30 sec - exiting 19:45:25 (9948): No heartbeat from core client for 30 sec - exiting 19:45:26 (9948): No heartbeat from core client for 30 sec - exiting 19:45:27 (9948): No heartbeat from core client for 30 sec - exiting 19:45:28 (9948): No heartbeat from core client for 30 sec - exiting 19:45:29 (9948): No heartbeat from core client for 30 sec - exiting 19:45:30 (9948): No heartbeat from core client for 30 sec - exiting 19:45:31 (9948): No heartbeat from core client for 30 sec - exiting 19:45:32 (9948): No heartbeat from core client for 30 sec - exiting 19:45:34 (9948): No heartbeat from core client for 30 sec - exiting 19:45:35 (9948): No heartbeat from core client for 30 sec - exiting 19:45:36 (9948): No heartbeat from core client for 30 sec - exiting 19:45:37 (9948): No heartbeat from core client for 30 sec - exiting 19:45:38 (9948): No heartbeat from core client for 30 sec - exiting 19:45:39 (9948): No heartbeat from core client for 30 sec - exiting 19:45:40 (9948): No heartbeat from core client for 30 sec - exiting 19:45:41 (9948): No heartbeat from core client for 30 sec - exiting 19:45:42 (9948): No heartbeat from core client for 30 sec - exiting 19:45:43 (9948): No heartbeat from core client for 30 sec - exiting 19:45:45 (9948): No heartbeat from core client for 30 sec - exiting 19:45:46 (9948): No heartbeat from core client for 30 sec - exiting 19:45:47 (9948): No heartbeat from core client for 30 sec - exiting 19:45:48 (9948): No heartbeat from core client for 30 sec - exiting 19:45:49 (9948): No heartbeat from core client for 30 sec - exiting 19:45:50 (9948): No heartbeat from core client for 30 sec - exiting 19:45:51 (9948): No heartbeat from core client for 30 sec - exiting 19:45:52 (9948): No heartbeat from core client for 30 sec - exiting 19:45:53 (9948): No heartbeat from core client for 30 sec - exiting 19:45:54 (9948): No heartbeat from core client for 30 sec - exiting 19:45:55 (9948): No heartbeat from core client for 30 sec - exiting 19:45:57 (9948): No heartbeat from core client for 30 sec - exiting 19:45:58 (9948): No heartbeat from core client for 30 sec - exiting 19:45:59 (9948): No heartbeat from core client for 30 sec - exiting 19:46:00 (9948): No heartbeat from core client for 30 sec - exiting 19:46:01 (9948): No heartbeat from core client for 30 sec - exiting 19:46:02 (9948): No heartbeat from core client for 30 sec - exiting 19:46:03 (9948): No heartbeat from core client for 30 sec - exiting 19:46:04 (9948): No heartbeat from core client for 30 sec - exiting 19:46:05 (9948): No heartbeat from core client for 30 sec - exiting 19:46:06 (9948): No heartbeat from core client for 30 sec - exiting 19:46:07 (9948): No heartbeat from core client for 30 sec - exiting 19:46:09 (9948): No heartbeat from core client for 30 sec - exiting 19:46:10 (9948): No heartbeat from core client for 30 sec - exiting 19:46:11 (9948): No heartbeat from core client for 30 sec - exiting 19:46:12 (9948): No heartbeat from core client for 30 sec - exiting 19:46:13 (9948): No heartbeat from core client for 30 sec - exiting 19:46:14 (9948): No heartbeat from core client for 30 sec - exiting 19:46:15 (9948): No heartbeat from core client for 30 sec - exiting 19:46:16 (9948): No heartbeat from core client for 30 sec - exiting 19:46:17 (9948): No heartbeat from core client for 30 sec - exiting 19:46:18 (9948): No heartbeat from core client for 30 sec - exiting 19:46:20 (9948): No heartbeat from core client for 30 sec - exiting 19:46:21 (9948): No heartbeat from core client for 30 sec - exiting 19:46:22 (9948): No heartbeat from core client for 30 sec - exiting 19:46:23 (9948): No heartbeat from core client for 30 sec - exiting 19:46:24 (9948): No heartbeat from core client for 30 sec - exiting 19:46:25 (9948): No heartbeat from core client for 30 sec - exiting 19:46:26 (9948): No heartbeat from core client for 30 sec - exiting 19:46:27 (9948): No heartbeat from core client for 30 sec - exiting 19:46:28 (9948): No heartbeat from core client for 30 sec - exiting 19:46:29 (9948): No heartbeat from core client for 30 sec - exiting 19:46:30 (9948): No heartbeat from core client for 30 sec - exiting 19:46:32 (9948): No heartbeat from core client for 30 sec - exiting 19:46:33 (9948): No heartbeat from core client for 30 sec - exiting 19:46:34 (9948): No heartbeat from core client for 30 sec - exiting 19:46:35 (9948): No heartbeat from core client for 30 sec - exiting 19:46:36 (9948): No heartbeat from core client for 30 sec - exiting 19:46:37 (9948): No heartbeat from core client for 30 sec - exiting 19:46:38 (9948): No heartbeat from core client for 30 sec - exiting 19:46:39 (9948): No heartbeat from core client for 30 sec - exiting 19:46:40 (9948): No heartbeat from core client for 30 sec - exiting 19:46:41 (9948): No heartbeat from core client for 30 sec - exiting 19:46:42 (9948): No heartbeat from core client for 30 sec - exiting 19:46:44 (9948): No heartbeat from core client for 30 sec - exiting 19:46:45 (9948): No heartbeat from core client for 30 sec - exiting 19:46:46 (9948): No heartbeat from core client for 30 sec - exiting 19:46:47 (9948): No heartbeat from core client for 30 sec - exiting 19:46:48 (9948): No heartbeat from core client for 30 sec - exiting 19:46:49 (9948): No heartbeat from core client for 30 sec - exiting 19:46:50 (9948): No heartbeat from core client for 30 sec - exiting 19:46:51 (9948): No heartbeat from core client for 30 sec - exiting 19:46:52 (9948): No heartbeat from core client for 30 sec - exiting 19:46:53 (9948): No heartbeat from core client for 30 sec - exiting 19:46:54 (9948): No heartbeat from core client for 30 sec - exiting 19:46:56 (9948): No heartbeat from core client for 30 sec - exiting 19:46:57 (9948): No heartbeat from core client for 30 sec - exiting 19:46:58 (9948): No heartbeat from core client for 30 sec - exiting 19:46:59 (9948): No heartbeat from core client for 30 sec - exiting 19:47:00 (9948): No heartbeat from core client for 30 sec - exiting 19:47:01 (9948): No heartbeat from core client for 30 sec - exiting 19:47:02 (9948): No heartbeat from core client for 30 sec - exiting 19:47:03 (9948): No heartbeat from core client for 30 sec - exiting 19:47:04 (9948): No heartbeat from core client for 30 sec - exiting 19:47:05 (9948): No heartbeat from core client for 30 sec - exiting 19:47:06 (9948): No heartbeat from core client for 30 sec - exiting 19:47:08 (9948): No heartbeat from core client for 30 sec - exiting 19:47:09 (9948): No heartbeat from core client for 30 sec - exiting 19:47:10 (9948): No heartbeat from core client for 30 sec - exiting 19:47:11 (9948): No heartbeat from core client for 30 sec - exiting 19:47:12 (9948): No heartbeat from core client for 30 sec - exiting 19:47:13 (9948): No heartbeat from core client for 30 sec - exiting 19:47:14 (9948): No heartbeat from core client for 30 sec - exiting 19:47:15 (9948): No heartbeat from core client for 30 sec - exiting 19:47:16 (9948): No heartbeat from core client for 30 sec - exiting 19:47:17 (9948): No heartbeat from core client for 30 sec - exiting 19:47:19 (9948): No heartbeat from core client for 30 sec - exiting 19:47:20 (9948): No heartbeat from core client for 30 sec - exiting 19:47:21 (9948): No heartbeat from core client for 30 sec - exiting 19:47:22 (9948): No heartbeat from core client for 30 sec - exiting 19:47:23 (9948): No heartbeat from core client for 30 sec - exiting 19:47:24 (9948): No heartbeat from core client for 30 sec - exiting 19:47:25 (9948): No heartbeat from core client for 30 sec - exiting 19:47:26 (9948): No heartbeat from core client for 30 sec - exiting 19:47:27 (9948): No heartbeat from core client for 30 sec - exiting 19:47:28 (9948): No heartbeat from core client for 30 sec - exiting 19:47:29 (9948): No heartbeat from core client for 30 sec - exiting 19:47:31 (9948): No heartbeat from core client for 30 sec - exiting 19:47:32 (9948): No heartbeat from core client for 30 sec - exiting 19:47:33 (9948): No heartbeat from core client for 30 sec - exiting 19:47:34 (9948): No heartbeat from core client for 30 sec - exiting 19:47:35 (9948): No heartbeat from core client for 30 sec - exiting 19:47:36 (9948): No heartbeat from core client for 30 sec - exiting 19:48:11 (9948): No heartbeat from core client for 30 sec - exiting 19:48:12 (9948): No heartbeat from core client for 30 sec - exiting 19:48:13 (9948): No heartbeat from core client for 30 sec - exiting 19:48:14 (9948): No heartbeat from core client for 30 sec - exiting 19:48:15 (9948): No heartbeat from core client for 30 sec - exiting 19:48:16 (9948): No heartbeat from core client for 30 sec - exiting 19:48:18 (9948): No heartbeat from core client for 30 sec - exiting 19:48:19 (9948): No heartbeat from core client for 30 sec - exiting 19:48:20 (9948): No heartbeat from core client for 30 sec - exiting 19:48:21 (9948): No heartbeat from core client for 30 sec - exiting 19:48:22 (9948): No heartbeat from core client for 30 sec - exiting 19:48:23 (9948): No heartbeat from core client for 30 sec - exiting 19:48:24 (9948): No heartbeat from core client for 30 sec - exiting 19:48:25 (9948): No heartbeat from core client for 30 sec - exiting 19:48:26 (9948): No heartbeat from core client for 30 sec - exiting 19:48:27 (9948): No heartbeat from core client for 30 sec - exiting 19:48:28 (9948): No heartbeat from core client for 30 sec - exiting 19:48:30 (9948): No heartbeat from core client for 30 sec - exiting 19:48:31 (9948): No heartbeat from core client for 30 sec - exiting 19:48:32 (9948): No heartbeat from core client for 30 sec - exiting 19:48:33 (9948): No heartbeat from core client for 30 sec - exiting 19:48:34 (9948): No heartbeat from core client for 30 sec - exiting 19:48:35 (9948): No heartbeat from core client for 30 sec - exiting 19:48:36 (9948): No heartbeat from core client for 30 sec - exiting 19:48:37 (9948): No heartbeat from core client for 30 sec - exiting 19:48:38 (9948): No heartbeat from core client for 30 sec - exiting 19:48:39 (9948): No heartbeat from core client for 30 sec - exiting 19:48:40 (9948): No heartbeat from core client for 30 sec - exiting 19:48:42 (9948): No heartbeat from core client for 30 sec - exiting 19:48:43 (9948): No heartbeat from core client for 30 sec - exiting 19:48:44 (9948): No heartbeat from core client for 30 sec - exiting 19:48:45 (9948): No heartbeat from core client for 30 sec - exiting 19:48:46 (9948): No heartbeat from core client for 30 sec - exiting 19:48:47 (9948): No heartbeat from core client for 30 sec - exiting 19:48:48 (9948): No heartbeat from core client for 30 sec - exiting 19:48:49 (9948): No heartbeat from core client for 30 sec - exiting 19:48:50 (9948): No heartbeat from core client for 30 sec - exiting 19:48:51 (9948): No heartbeat from core client for 30 sec - exiting 19:48:52 (9948): No heartbeat from core client for 30 sec - exiting 19:48:54 (9948): No heartbeat from core client for 30 sec - exiting 19:48:55 (9948): No heartbeat from core client for 30 sec - exiting 19:48:56 (9948): No heartbeat from core client for 30 sec - exiting 19:48:57 (9948): No heartbeat from core client for 30 sec - exiting 19:48:58 (9948): No heartbeat from core client for 30 sec - exiting 19:48:59 (9948): No heartbeat from core client for 30 sec - exiting 19:49:00 (9948): No heartbeat from core client for 30 sec - exiting 19:49:01 (9948): No heartbeat from core client for 30 sec - exiting 19:49:02 (9948): No heartbeat from core client for 30 sec - exiting 19:49:03 (9948): No heartbeat from core client for 30 sec - exiting 19:49:04 (9948): No heartbeat from core client for 30 sec - exiting 19:49:06 (9948): No heartbeat from core client for 30 sec - exiting 19:49:07 (9948): No heartbeat from core client for 30 sec - exiting 19:49:08 (9948): No heartbeat from core client for 30 sec - exiting 19:49:09 (9948): No heartbeat from core client for 30 sec - exiting 19:49:10 (9948): No heartbeat from core client for 30 sec - exiting 19:49:11 (9948): No heartbeat from core client for 30 sec - exiting 19:49:12 (9948): No heartbeat from core client for 30 sec - exiting 19:49:13 (9948): No heartbeat from core client for 30 sec - exiting 19:49:14 (9948): No heartbeat from core client for 30 sec - exiting 19:49:15 (9948): No heartbeat from core client for 30 sec - exiting 19:49:17 (9948): No heartbeat from core client for 30 sec - exiting 19:49:18 (9948): No heartbeat from core client for 30 sec - exiting 19:49:19 (9948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:20 (9948): No heartbeat from core client for 30 sec - exiting 19:49:21 (9948): No heartbeat from core client for 30 sec - exiting 19:53:33 (10296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:34 (10296): No heartbeat from core client for 30 sec - exiting 19:53:35 (10296): No heartbeat from core client for 30 sec - exiting 19:53:36 (10296): No heartbeat from core client for 30 sec - exiting 19:53:37 (10296): No heartbeat from core client for 30 sec - exiting 19:53:38 (10296): No heartbeat from core client for 30 sec - exiting 19:53:40 (10296): No heartbeat from core client for 30 sec - exiting 19:53:41 (10296): No heartbeat from core client for 30 sec - exiting 19:53:42 (10296): No heartbeat from core client for 30 sec - exiting 19:53:43 (10296): No heartbeat from core client for 30 sec - exiting 19:53:44 (10296): No heartbeat from core client for 30 sec - exiting 19:56:51 (11916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:52 (11916): No heartbeat from core client for 30 sec - exiting 19:56:53 (11916): No heartbeat from core client for 30 sec - exiting 19:56:54 (11916): No heartbeat from core client for 30 sec - exiting 19:56:55 (11916): No heartbeat from core client for 30 sec - exiting 19:56:56 (11916): No heartbeat from core client for 30 sec - exiting 19:56:57 (11916): No heartbeat from core client for 30 sec - exiting 19:56:58 (11916): No heartbeat from core client for 30 sec - exiting 19:56:59 (11916): No heartbeat from core client for 30 sec - exiting 19:57:00 (11916): No heartbeat from core client for 30 sec - exiting 19:57:02 (11916): No heartbeat from core client for 30 sec - exiting 20:00:57 (10936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:58 (10936): No heartbeat from core client for 30 sec - exiting 20:00:59 (10936): No heartbeat from core client for 30 sec - exiting 20:01:00 (10936): No heartbeat from core client for 30 sec - exiting 20:01:01 (10936): No heartbeat from core client for 30 sec - exiting 20:01:02 (10936): No heartbeat from core client for 30 sec - exiting 20:01:03 (10936): No heartbeat from core client for 30 sec - exiting 20:01:04 (10936): No heartbeat from core client for 30 sec - exiting 20:01:06 (10936): No heartbeat from core client for 30 sec - exiting 20:01:07 (10936): No heartbeat from core client for 30 sec - exiting 20:01:08 (10936): No heartbeat from core client for 30 sec - exiting 20:05:17 (308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:18 (308): No heartbeat from core client for 30 sec - exiting 20:10:22 (11756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:37 (11756): No heartbeat from core client for 30 sec - exiting 20:10:38 (11756): No heartbeat from core client for 30 sec - exiting 20:10:39 (11756): No heartbeat from core client for 30 sec - exiting 20:10:40 (11756): No heartbeat from core client for 30 sec - exiting 20:10:41 (11756): No heartbeat from core client for 30 sec - exiting 20:10:42 (11756): No heartbeat from core client for 30 sec - exiting 20:10:43 (11756): No heartbeat from core client for 30 sec - exiting 20:10:45 (11756): No heartbeat from core client for 30 sec - exiting 20:10:46 (11756): No heartbeat from core client for 30 sec - exiting 20:10:47 (11756): No heartbeat from core client for 30 sec - exiting 20:12:09 (11548): No heartbeat from core client for 30 sec - exiting 20:12:23 (11548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:24 (11548): No heartbeat from core client for 30 sec - exiting 20:12:25 (11548): No heartbeat from core client for 30 sec - exiting 20:15:22 (11996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:38 (6440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:39 (6440): No heartbeat from core client for 30 sec - exiting 20:19:45 (6440): No heartbeat from core client for 30 sec - exiting 20:19:46 (6440): No heartbeat from core client for 30 sec - exiting 20:19:47 (6440): No heartbeat from core client for 30 sec - exiting 20:19:49 (6440): No heartbeat from core client for 30 sec - exiting 20:28:12 (11524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:12 (11524): No heartbeat from core client for 30 sec - exiting 20:29:13 (11524): No heartbeat from core client for 30 sec - exiting 20:29:14 (11524): No heartbeat from core client for 30 sec - exiting 20:29:15 (11524): No heartbeat from core client for 30 sec - exiting 20:29:16 (11524): No heartbeat from core client for 30 sec - exiting 20:35:50 (9736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:51 (9736): No heartbeat from core client for 30 sec - exiting 20:38:46 (2844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:47 (2844): No heartbeat from core client for 30 sec - exiting 20:38:48 (2844): No heartbeat from core client for 30 sec - exiting 20:38:49 (2844): No heartbeat from core client for 30 sec - exiting 20:38:50 (2844): No heartbeat from core client for 30 sec - exiting 20:38:51 (2844): No heartbeat from core client for 30 sec - exiting 20:38:52 (2844): No heartbeat from core client for 30 sec - exiting 20:38:53 (2844): No heartbeat from core client for 30 sec - exiting 20:38:54 (2844): No heartbeat from core client for 30 sec - exiting 20:38:56 (2844): No heartbeat from core client for 30 sec - exiting 20:38:57 (2844): No heartbeat from core client for 30 sec - exiting 20:48:46 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:20:58 (6960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:09 (6960): No heartbeat from core client for 30 sec - exiting 21:21:10 (6960): No heartbeat from core client for 30 sec - exiting 21:21:11 (6960): No heartbeat from core client for 30 sec - exiting 21:21:13 (6960): No heartbeat from core client for 30 sec - exiting 21:21:14 (6960): No heartbeat from core client for 30 sec - exiting 21:21:15 (6960): No heartbeat from core client for 30 sec - exiting 21:21:16 (6960): No heartbeat from core client for 30 sec - exiting 21:21:17 (6960): No heartbeat from core client for 30 sec - exiting 21:21:18 (6960): No heartbeat from core client for 30 sec - exiting 21:21:19 (6960): No heartbeat from core client for 30 sec - exiting 21:21:20 (6960): No heartbeat from core client for 30 sec - exiting 21:21:21 (6960): No heartbeat from core client for 30 sec - exiting 21:21:22 (6960): No heartbeat from core client for 30 sec - exiting 21:21:23 (6960): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:18:20 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:19 (9096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:56 (9796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:25 (9988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:29 (8072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:28:30 (10120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:30 (7876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:31 (10120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:32 (9356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:28:34 (7092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:27 (7480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:44 (5032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:48:45 (7852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:28:47 (10292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:47:34 (10552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:21 (8040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:05 (10876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:55 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:18:48 (9976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:18:57 (9976): No heartbeat from core client for 30 sec - exiting 22:18:58 (9976): No heartbeat from core client for 30 sec - exiting 22:18:59 (9976): No heartbeat from core client for 30 sec - exiting 22:19:01 (9976): No heartbeat from core client for 30 sec - exiting 22:19:02 (9976): No heartbeat from core client for 30 sec - exiting 22:19:03 (9976): No heartbeat from core client for 30 sec - exiting 22:19:04 (9976): No heartbeat from core client for 30 sec - exiting 22:19:05 (9976): No heartbeat from core client for 30 sec - exiting 23:47:57 (7100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:58:37 (8460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:11 (10560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:31:12 (8116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:13 (7236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish 07:11:22 (4988): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Sep 2013 13:37:43	1158872	16026042	hadcm3n_857a_1980_40_008464698_0	103,680	319,224	3.0789
23 Sep 2013 23:59:33	1158872	16026042	hadcm3n_857a_1980_40_008464698_0	77,760	240,490	3.0927
23 Sep 2013 10:09:04	1158872	16026042	hadcm3n_857a_1980_40_008464698_0	51,840	159,720	3.0810
22 Sep 2013 00:37:57	1158872	16026042	hadcm3n_857a_1980_40_008464698_0	25,920	79,182	3.0549