Task 16011328

Name	hadcm3n_o3i1_1980_40_008407800_1
Workunit	8558656
Created	11 Sep 2013, 0:50:32 UTC
Sent	11 Sep 2013, 1:04:14 UTC
Report deadline	11 Dec 2013, 8:31:25 UTC
Received	12 Sep 2013, 12:19:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-2 (0xFFFFFFFE) Unknown error code
Computer ID	1127359
Run time	18 hours 23 min 48 sec
CPU time	16 hours 46 min 13 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	2.91 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -2 (0xfffffffe) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:32:53 (97256): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:30:44 (96644): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:46:08 (97864): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:44:35 (95044): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:52:28 (98408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:04 (98572): No heartbeat from core client for 30 sec - exiting 10:54:05 (98572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:47 (98544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:49 (98544): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:04:48 (97936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:49 (97936): No heartbeat from core client for 30 sec - exiting 12:04:50 (97936): No heartbeat from core client for 30 sec - exiting 12:04:52 (97936): No heartbeat from core client for 30 sec - exiting 12:04:53 (97936): No heartbeat from core client for 30 sec - exiting 12:04:54 (97936): No heartbeat from core client for 30 sec - exiting 12:04:55 (97936): No heartbeat from core client for 30 sec - exiting 12:06:02 (87036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:20 (99100): No heartbeat from core client for 30 sec - exiting 12:08:21 (99100): No heartbeat from core client for 30 sec - exiting 12:08:22 (99100): No heartbeat from core client for 30 sec - exiting 12:08:23 (99100): No heartbeat from core client for 30 sec - exiting 12:08:24 (99100): No heartbeat from core client for 30 sec - exiting 12:08:25 (99100): No heartbeat from core client for 30 sec - exiting 12:08:26 (99100): No heartbeat from core client for 30 sec - exiting 12:08:28 (99100): No heartbeat from core client for 30 sec - exiting 12:08:29 (99100): No heartbeat from core client for 30 sec - exiting 12:08:30 (99100): No heartbeat from core client for 30 sec - exiting 12:08:31 (99100): No heartbeat from core client for 30 sec - exiting 12:08:32 (99100): No heartbeat from core client for 30 sec - exiting 12:08:33 (99100): No heartbeat from core client for 30 sec - exiting 12:08:34 (99100): No heartbeat from core client for 30 sec - exiting 12:08:35 (99100): No heartbeat from core client for 30 sec - exiting 12:08:36 (99100): No heartbeat from core client for 30 sec - exiting 12:08:37 (99100): No heartbeat from core client for 30 sec - exiting 12:08:38 (99100): No heartbeat from core client for 30 sec - exiting 12:08:40 (99100): No heartbeat from core client for 30 sec - exiting 12:08:41 (99100): No heartbeat from core client for 30 sec - exiting 12:08:42 (99100): No heartbeat from core client for 30 sec - exiting 12:08:43 (99100): No heartbeat from core client for 30 sec - exiting 12:08:44 (99100): No heartbeat from core client for 30 sec - exiting 12:08:45 (99100): No heartbeat from core client for 30 sec - exiting 12:08:46 (99100): No heartbeat from core client for 30 sec - exiting 12:08:47 (99100): No heartbeat from core client for 30 sec - exiting 12:08:48 (99100): No heartbeat from core client for 30 sec - exiting 12:08:49 (99100): No heartbeat from core client for 30 sec - exiting 12:08:50 (99100): No heartbeat from core client for 30 sec - exiting 12:08:52 (99100): No heartbeat from core client for 30 sec - exiting 12:08:53 (99100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:17 (95472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:14:41 (98632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:18 (99088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:11 (99292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:23 (99288): No heartbeat from core client for 30 sec - exiting 12:21:50 (99288): No heartbeat from core client for 30 sec - exiting 12:21:51 (99288): No heartbeat from core client for 30 sec - exiting 12:21:52 (99288): No heartbeat from core client for 30 sec - exiting 12:21:53 (99288): No heartbeat from core client for 30 sec - exiting 12:21:54 (99288): No heartbeat from core client for 30 sec - exiting 12:21:55 (99288): No heartbeat from core client for 30 sec - exiting 12:21:56 (99288): No heartbeat from core client for 30 sec - exiting 12:21:58 (99288): No heartbeat from core client for 30 sec - exiting 12:21:59 (99288): No heartbeat from core client for 30 sec - exiting 12:22:00 (99288): No heartbeat from core client for 30 sec - exiting 12:22:01 (99288): No heartbeat from core client for 30 sec - exiting 12:22:02 (99288): No heartbeat from core client for 30 sec - exiting 12:22:03 (99288): No heartbeat from core client for 30 sec - exiting 12:22:04 (99288): No heartbeat from core client for 30 sec - exiting 12:22:05 (99288): No heartbeat from core client for 30 sec - exiting 12:22:06 (99288): No heartbeat from core client for 30 sec - exiting 12:22:07 (99288): No heartbeat from core client for 30 sec - exiting 12:22:08 (99288): No heartbeat from core client for 30 sec - exiting 12:22:10 (99288): No heartbeat from core client for 30 sec - exiting 12:22:11 (99288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:23:00 (99108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:53 (98720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:48 (97984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:00 (99212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:49 (99184): No heartbeat from core client for 30 sec - exiting 12:34:23 (99184): No heartbeat from core client for 30 sec - exiting 12:34:24 (99184): No heartbeat from core client for 30 sec - exiting 12:34:26 (99184): No heartbeat from core client for 30 sec - exiting 12:34:27 (99184): No heartbeat from core client for 30 sec - exiting 12:34:28 (99184): No heartbeat from core client for 30 sec - exiting 12:34:29 (99184): No heartbeat from core client for 30 sec - exiting 12:34:30 (99184): No heartbeat from core client for 30 sec - exiting 12:34:31 (99184): No heartbeat from core client for 30 sec - exiting 12:34:32 (99184): No heartbeat from core client for 30 sec - exiting 12:34:33 (99184): No heartbeat from core client for 30 sec - exiting 12:34:34 (99184): No heartbeat from core client for 30 sec - exiting 12:34:35 (99184): No heartbeat from core client for 30 sec - exiting 12:34:36 (99184): No heartbeat from core client for 30 sec - exiting 12:34:38 (99184): No heartbeat from core client for 30 sec - exiting 12:34:39 (99184): No heartbeat from core client for 30 sec - exiting 12:34:40 (99184): No heartbeat from core client for 30 sec - exiting 12:34:41 (99184): No heartbeat from core client for 30 sec - exiting 12:34:42 (99184): No heartbeat from core client for 30 sec - exiting 12:34:43 (99184): No heartbeat from core client for 30 sec - exiting 12:34:44 (99184): No heartbeat from core client for 30 sec - exiting 12:34:45 (99184): No heartbeat from core client for 30 sec - exiting 12:34:46 (99184): No heartbeat from core client for 30 sec - exiting 12:34:47 (99184): No heartbeat from core client for 30 sec - exiting 12:34:48 (99184): No heartbeat from core client for 30 sec - exiting 12:34:50 (99184): No heartbeat from core client for 30 sec - exiting 12:34:51 (99184): No heartbeat from core client for 30 sec - exiting 12:34:52 (99184): No heartbeat from core client for 30 sec - exiting 12:34:53 (99184): No heartbeat from core client for 30 sec - exiting 12:34:54 (99184): No heartbeat from core client for 30 sec - exiting 12:34:55 (99184): No heartbeat from core client for 30 sec - exiting 12:34:56 (99184): No heartbeat from core client for 30 sec - exiting 12:34:57 (99184): No heartbeat from core client for 30 sec - exiting 12:34:58 (99184): No heartbeat from core client for 30 sec - exiting 12:34:59 (99184): No heartbeat from core client for 30 sec - exiting 12:35:00 (99184): No heartbeat from core client for 30 sec - exiting 12:35:02 (99184): No heartbeat from core client for 30 sec - exiting 12:35:03 (99184): No heartbeat from core client for 30 sec - exiting 12:35:04 (99184): No heartbeat from core client for 30 sec - exiting 12:35:05 (99184): No heartbeat from core client for 30 sec - exiting 12:35:06 (99184): No heartbeat from core client for 30 sec - exiting 12:35:07 (99184): No heartbeat from core client for 30 sec - exiting 12:35:08 (99184): No heartbeat from core client for 30 sec - exiting 12:35:09 (99184): No heartbeat from core client for 30 sec - exiting 12:35:10 (99184): No heartbeat from core client for 30 sec - exiting 12:35:11 (99184): No heartbeat from core client for 30 sec - exiting 12:35:13 (99184): No heartbeat from core client for 30 sec - exiting 12:35:14 (99184): No heartbeat from core client for 30 sec - exiting 12:35:15 (99184): No heartbeat from core client for 30 sec - exiting 12:35:16 (99184): No heartbeat from core client for 30 sec - exiting 12:35:17 (99184): No heartbeat from core client for 30 sec - exiting 12:35:18 (99184): No heartbeat from core client for 30 sec - exiting 12:35:19 (99184): No heartbeat from core client for 30 sec - exiting 12:35:20 (99184): No heartbeat from core client for 30 sec - exiting 12:35:21 (99184): No heartbeat from core client for 30 sec - exiting 12:35:22 (99184): No heartbeat from core client for 30 sec - exiting 12:35:23 (99184): No heartbeat from core client for 30 sec - exiting 12:35:25 (99184): No heartbeat from core client for 30 sec - exiting 12:35:26 (99184): No heartbeat from core client for 30 sec - exiting 12:35:27 (99184): No heartbeat from core client for 30 sec - exiting 12:35:28 (99184): No heartbeat from core client for 30 sec - exiting 12:35:29 (99184): No heartbeat from core client for 30 sec - exiting 12:35:30 (99184): No heartbeat from core client for 30 sec - exiting 12:35:31 (99184): No heartbeat from core client for 30 sec - exiting 12:35:32 (99184): No heartbeat from core client for 30 sec - exiting 12:35:33 (99184): No heartbeat from core client for 30 sec - exiting 12:35:34 (99184): No heartbeat from core client for 30 sec - exiting 12:35:35 (99184): No heartbeat from core client for 30 sec - exiting 12:35:37 (99184): No heartbeat from core client for 30 sec - exiting 12:35:38 (99184): No heartbeat from core client for 30 sec - exiting 12:35:39 (99184): No heartbeat from core client for 30 sec - exiting 12:35:40 (99184): No heartbeat from core client for 30 sec - exiting 12:35:41 (99184): No heartbeat from core client for 30 sec - exiting 12:35:42 (99184): No heartbeat from core client for 30 sec - exiting 12:35:43 (99184): No heartbeat from core client for 30 sec - exiting 12:35:44 (99184): No heartbeat from core client for 30 sec - exiting 12:35:45 (99184): No heartbeat from core client for 30 sec - exiting 12:35:46 (99184): No heartbeat from core client for 30 sec - exiting 12:35:47 (99184): No heartbeat from core client for 30 sec - exiting 12:35:49 (99184): No heartbeat from core client for 30 sec - exiting 12:35:50 (99184): No heartbeat from core client for 30 sec - exiting 12:35:51 (99184): No heartbeat from core client for 30 sec - exiting 12:35:52 (99184): No heartbeat from core client for 30 sec - exiting 12:35:53 (99184): No heartbeat from core client for 30 sec - exiting 12:35:54 (99184): No heartbeat from core client for 30 sec - exiting 12:35:55 (99184): No heartbeat from core client for 30 sec - exiting 12:35:56 (99184): No heartbeat from core client for 30 sec - exiting 12:35:57 (99184): No heartbeat from core client for 30 sec - exiting 12:35:58 (99184): No heartbeat from core client for 30 sec - exiting 12:35:59 (99184): No heartbeat from core client for 30 sec - exiting 12:36:01 (99184): No heartbeat from core client for 30 sec - exiting 12:36:02 (99184): No heartbeat from core client for 30 sec - exiting 12:36:03 (99184): No heartbeat from core client for 30 sec - exiting 12:36:04 (99184): No heartbeat from core client for 30 sec - exiting 12:36:05 (99184): No heartbeat from core client for 30 sec - exiting 12:36:06 (99184): No heartbeat from core client for 30 sec - exiting 12:36:07 (99184): No heartbeat from core client for 30 sec - exiting 12:36:08 (99184): No heartbeat from core client for 30 sec - exiting 12:36:09 (99184): No heartbeat from core client for 30 sec - exiting 12:36:10 (99184): No heartbeat from core client for 30 sec - exiting 12:36:12 (99184): No heartbeat from core client for 30 sec - exiting 12:36:13 (99184): No heartbeat from core client for 30 sec - exiting 12:36:14 (99184): No heartbeat from core client for 30 sec - exiting 12:36:15 (99184): No heartbeat from core client for 30 sec - exiting 12:36:16 (99184): No heartbeat from core client for 30 sec - exiting 12:36:17 (99184): No heartbeat from core client for 30 sec - exiting 12:36:18 (99184): No heartbeat from core client for 30 sec - exiting 12:36:19 (99184): No heartbeat from core client for 30 sec - exiting 12:36:20 (99184): No heartbeat from core client for 30 sec - exiting 12:36:21 (99184): No heartbeat from core client for 30 sec - exiting 12:36:22 (99184): No heartbeat from core client for 30 sec - exiting 12:36:24 (99184): No heartbeat from core client for 30 sec - exiting 12:36:25 (99184): No heartbeat from core client for 30 sec - exiting 12:36:26 (99184): No heartbeat from core client for 30 sec - exiting 12:36:31 (99184): No heartbeat from core client for 30 sec - exiting 12:36:32 (99184): No heartbeat from core client for 30 sec - exiting 12:36:33 (99184): No heartbeat from core client for 30 sec - exiting 12:36:34 (99184): No heartbeat from core client for 30 sec - exiting 12:36:35 (99184): No heartbeat from core client for 30 sec - exiting 12:36:36 (99184): No heartbeat from core client for 30 sec - exiting 12:36:38 (99184): No heartbeat from core client for 30 sec - exiting 12:36:39 (99184): No heartbeat from core client for 30 sec - exiting 12:36:40 (99184): No heartbeat from core client for 30 sec - exiting 12:36:41 (99184): No heartbeat from core client for 30 sec - exiting 12:36:42 (99184): No heartbeat from core client for 30 sec - exiting 12:36:43 (99184): No heartbeat from core client for 30 sec - exiting 12:36:44 (99184): No heartbeat from core client for 30 sec - exiting 12:36:45 (99184): No heartbeat from core client for 30 sec - exiting 12:36:46 (99184): No heartbeat from core client for 30 sec - exiting 12:36:47 (99184): No heartbeat from core client for 30 sec - exiting 12:36:48 (99184): No heartbeat from core client for 30 sec - exiting 12:36:50 (99184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:51 (99184): No heartbeat from core client for 30 sec - exiting 12:36:52 (99184): No heartbeat from core client for 30 sec - exiting 12:36:53 (99184): No heartbeat from core client for 30 sec - exiting 12:36:54 (99184): No heartbeat from core client for 30 sec - exiting 12:36:55 (99184): No heartbeat from core client for 30 sec - exiting 12:36:56 (99184): No heartbeat from core client for 30 sec - exiting 12:36:59 (99184): No heartbeat from core client for 30 sec - exiting 12:37:00 (99184): No heartbeat from core client for 30 sec - exiting 12:42:19 (98608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:38 (96296): No heartbeat from core client for 30 sec - exiting 12:43:39 (96296): No heartbeat from core client for 30 sec - exiting 12:43:40 (96296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:04 (99204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:01 (98620): No heartbeat from core client for 30 sec - exiting 12:49:02 (98620): No heartbeat from core client for 30 sec - exiting 12:49:03 (98620): No heartbeat from core client for 30 sec - exiting 12:49:04 (98620): No heartbeat from core client for 30 sec - exiting 12:49:05 (98620): No heartbeat from core client for 30 sec - exiting 12:49:06 (98620): No heartbeat from core client for 30 sec - exiting 12:49:07 (98620): No heartbeat from core client for 30 sec - exiting 12:49:08 (98620): No heartbeat from core client for 30 sec - exiting 12:49:09 (98620): No heartbeat from core client for 30 sec - exiting 12:49:11 (98620): No heartbeat from core client for 30 sec - exiting 12:49:12 (98620): No heartbeat from core client for 30 sec - exiting 12:49:13 (98620): No heartbeat from core client for 30 sec - exiting 12:49:14 (98620): No heartbeat from core client for 30 sec - exiting 12:49:15 (98620): No heartbeat from core client for 30 sec - exiting 12:49:16 (98620): No heartbeat from core client for 30 sec - exiting 12:49:17 (98620): No heartbeat from core client for 30 sec - exiting 12:49:18 (98620): No heartbeat from core client for 30 sec - exiting 12:49:19 (98620): No heartbeat from core client for 30 sec - exiting 12:49:20 (98620): No heartbeat from core client for 30 sec - exiting 12:49:21 (98620): No heartbeat from core client for 30 sec - exiting 12:49:23 (98620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:51:07 (98848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:15 (97332): No heartbeat from core client for 30 sec - exiting 12:52:16 (97332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:30 (98312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:33 (98648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:58:06 (99136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:28 (99216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:18 (97332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:17 (99028): No heartbeat from core client for 30 sec - exiting 13:02:18 (99028): No heartbeat from core client for 30 sec - exiting 13:02:19 (99028): No heartbeat from core client for 30 sec - exiting 13:02:20 (99028): No heartbeat from core client for 30 sec - exiting 13:02:21 (99028): No heartbeat from core client for 30 sec - exiting 13:02:22 (99028): No heartbeat from core client for 30 sec - exiting 13:02:23 (99028): No heartbeat from core client for 30 sec - exiting 13:02:24 (99028): No heartbeat from core client for 30 sec - exiting 13:02:26 (99028): No heartbeat from core client for 30 sec - exiting 13:02:27 (99028): No heartbeat from core client for 30 sec - exiting 13:02:28 (99028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:05:03 (97460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:55 (96556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:08:46 (82352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:08 (99836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:09 (98228): No heartbeat from core client for 30 sec - exiting 13:14:10 (98228): No heartbeat from core client for 30 sec - exiting 13:14:12 (98228): No heartbeat from core client for 30 sec - exiting 13:14:13 (98228): No heartbeat from core client for 30 sec - exiting 13:14:14 (98228): No heartbeat from core client for 30 sec - exiting 13:14:15 (98228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:15:59 (99532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:17:09 (99384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:22:05 (99844): No heartbeat from core client for 30 sec - exiting 13:22:06 (99844): No heartbeat from core client for 30 sec - exiting 13:22:07 (99844): No heartbeat from core client for 30 sec - exiting 13:22:08 (99844): No heartbeat from core client for 30 sec - exiting 13:22:09 (99844): No heartbeat from core client for 30 sec - exiting 13:22:10 (99844): No heartbeat from core client for 30 sec - exiting 13:22:11 (99844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:35 (99852): No heartbeat from core client for 30 sec - exiting 13:24:36 (99852): No heartbeat from core client for 30 sec - exiting 13:24:37 (99852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:10 (99912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:03 (99640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:30:53 (99580): No heartbeat from core client for 30 sec - exiting 13:31:07 (99580): No heartbeat from core client for 30 sec - exiting 13:31:08 (99580): No heartbeat from core client for 30 sec - exiting 13:31:10 (99580): No heartbeat from core client for 30 sec - exiting 13:31:11 (99580): No heartbeat from core client for 30 sec - exiting 13:31:12 (99580): No heartbeat from core client for 30 sec - exiting 13:31:13 (99580): No heartbeat from core client for 30 sec - exiting 13:31:14 (99580): No heartbeat from core client for 30 sec - exiting 13:31:15 (99580): No heartbeat from core client for 30 sec - exiting 13:31:16 (99580): No heartbeat from core client for 30 sec - exiting 13:31:17 (99580): No heartbeat from core client for 30 sec - exiting 13:31:18 (99580): No heartbeat from core client for 30 sec - exiting 13:31:19 (99580): No heartbeat from core client for 30 sec - exiting 13:31:20 (99580): No heartbeat from core client for 30 sec - exiting 13:31:22 (99580): No heartbeat from core client for 30 sec - exiting 13:31:23 (99580): No heartbeat from core client for 30 sec - exiting 13:31:24 (99580): No heartbeat from core client for 30 sec - exiting 13:31:25 (99580): No heartbeat from core client for 30 sec - exiting 13:31:26 (99580): No heartbeat from core client for 30 sec - exiting 13:31:27 (99580): No heartbeat from core client for 30 sec - exiting 13:31:28 (99580): No heartbeat from core client for 30 sec - exiting 13:31:29 (99580): No heartbeat from core client for 30 sec - exiting 13:31:30 (99580): No heartbeat from core client for 30 sec - exiting 13:31:31 (99580): No heartbeat from core client for 30 sec - exiting 13:31:32 (99580): No heartbeat from core client for 30 sec - exiting 13:31:34 (99580): No heartbeat from core client for 30 sec - exiting 13:31:35 (99580): No heartbeat from core client for 30 sec - exiting 13:31:36 (99580): No heartbeat from core client for 30 sec - exiting 13:31:37 (99580): No heartbeat from core client for 30 sec - exiting 13:31:38 (99580): No heartbeat from core client for 30 sec - exiting 13:31:39 (99580): No heartbeat from core client for 30 sec - exiting 13:31:40 (99580): No heartbeat from core client for 30 sec - exiting 13:31:41 (99580): No heartbeat from core client for 30 sec - exiting 13:31:42 (99580): No heartbeat from core client for 30 sec - exiting 13:31:43 (99580): No heartbeat from core client for 30 sec - exiting 13:31:44 (99580): No heartbeat from core client for 30 sec - exiting 13:31:46 (99580): No heartbeat from core client for 30 sec - exiting 13:31:47 (99580): No heartbeat from core client for 30 sec - exiting 13:31:48 (99580): No heartbeat from core client for 30 sec - exiting 13:31:49 (99580): No heartbeat from core client for 30 sec - exiting 13:31:50 (99580): No heartbeat from core client for 30 sec - exiting 13:31:51 (99580): No heartbeat from core client for 30 sec - exiting 13:31:52 (99580): No heartbeat from core client for 30 sec - exiting 13:31:53 (99580): No heartbeat from core client for 30 sec - exiting 13:31:54 (99580): No heartbeat from core client for 30 sec - exiting 13:31:55 (99580): No heartbeat from core client for 30 sec - exiting 13:31:56 (99580): No heartbeat from core client for 30 sec - exiting 13:31:58 (99580): No heartbeat from core client for 30 sec - exiting 13:31:59 (99580): No heartbeat from core client for 30 sec - exiting 13:32:00 (99580): No heartbeat from core client for 30 sec - exiting 13:32:01 (99580): No heartbeat from core client for 30 sec - exiting 13:32:02 (99580): No heartbeat from core client for 30 sec - exiting 13:32:03 (99580): No heartbeat from core client for 30 sec - exiting 13:32:04 (99580): No heartbeat from core client for 30 sec - exiting 13:32:05 (99580): No heartbeat from core client for 30 sec - exiting 13:32:06 (99580): No heartbeat from core client for 30 sec - exiting 13:32:07 (99580): No heartbeat from core client for 30 sec - exiting 13:32:08 (99580): No heartbeat from core client for 30 sec - exiting 13:32:10 (99580): No heartbeat from core client for 30 sec - exiting 13:32:11 (99580): No heartbeat from core client for 30 sec - exiting 13:32:12 (99580): No heartbeat from core client for 30 sec - exiting 13:32:13 (99580): No heartbeat from core client for 30 sec - exiting 13:32:14 (99580): No heartbeat from core client for 30 sec - exiting 13:32:15 (99580): No heartbeat from core client for 30 sec - exiting 13:32:16 (99580): No heartbeat from core client for 30 sec - exiting 13:32:17 (99580): No heartbeat from core client for 30 sec - exiting 13:32:18 (99580): No heartbeat from core client for 30 sec - exiting 13:32:19 (99580): No heartbeat from core client for 30 sec - exiting 13:32:21 (99580): No heartbeat from core client for 30 sec - exiting 13:32:22 (99580): No heartbeat from core client for 30 sec - exiting 13:32:23 (99580): No heartbeat from core client for 30 sec - exiting 13:32:24 (99580): No heartbeat from core client for 30 sec - exiting 13:32:25 (99580): No heartbeat from core client for 30 sec - exiting 13:32:26 (99580): No heartbeat from core client for 30 sec - exiting 13:32:27 (99580): No heartbeat from core client for 30 sec - exiting 13:32:28 (99580): No heartbeat from core client for 30 sec - exiting 13:32:29 (99580): No heartbeat from core client for 30 sec - exiting 13:32:30 (99580): No heartbeat from core client for 30 sec - exiting 13:32:31 (99580): No heartbeat from core client for 30 sec - exiting 13:32:33 (99580): No heartbeat from core client for 30 sec - exiting 13:32:34 (99580): No heartbeat from core client for 30 sec - exiting 13:32:35 (99580): No heartbeat from core client for 30 sec - exiting 13:32:36 (99580): No heartbeat from core client for 30 sec - exiting 13:32:37 (99580): No heartbeat from core client for 30 sec - exiting 13:32:38 (99580): No heartbeat from core client for 30 sec - exiting 13:32:39 (99580): No heartbeat from core client for 30 sec - exiting 13:32:40 (99580): No heartbeat from core client for 30 sec - exiting 13:32:41 (99580): No heartbeat from core client for 30 sec - exiting 13:32:42 (99580): No heartbeat from core client for 30 sec - exiting 13:32:43 (99580): No heartbeat from core client for 30 sec - exiting 13:32:45 (99580): No heartbeat from core client for 30 sec - exiting 13:32:46 (99580): No heartbeat from core client for 30 sec - exiting 13:32:47 (99580): No heartbeat from core client for 30 sec - exiting 13:32:48 (99580): No heartbeat from core client for 30 sec - exiting 13:32:49 (99580): No heartbeat from core client for 30 sec - exiting 13:32:50 (99580): No heartbeat from core client for 30 sec - exiting 13:32:51 (99580): No heartbeat from core client for 30 sec - exiting 13:32:52 (99580): No heartbeat from core client for 30 sec - exiting 13:32:53 (99580): No heartbeat from core client for 30 sec - exiting 13:32:54 (99580): No heartbeat from core client for 30 sec - exiting 13:32:55 (99580): No heartbeat from core client for 30 sec - exiting 13:32:57 (99580): No heartbeat from core client for 30 sec - exiting 13:32:58 (99580): No heartbeat from core client for 30 sec - exiting 13:32:59 (99580): No heartbeat from core client for 30 sec - exiting 13:33:00 (99580): No heartbeat from core client for 30 sec - exiting 13:33:01 (99580): No heartbeat from core client for 30 sec - exiting 13:33:02 (99580): No heartbeat from core client for 30 sec - exiting 13:33:03 (99580): No heartbeat from core client for 30 sec - exiting 13:33:04 (99580): No heartbeat from core client for 30 sec - exiting 13:33:05 (99580): No heartbeat from core client for 30 sec - exiting 13:33:06 (99580): No heartbeat from core client for 30 sec - exiting 13:33:08 (99580): No heartbeat from core client for 30 sec - exiting 13:33:09 (99580): No heartbeat from core client for 30 sec - exiting 13:33:10 (99580): No heartbeat from core client for 30 sec - exiting 13:33:11 (99580): No heartbeat from core client for 30 sec - exiting 13:33:12 (99580): No heartbeat from core client for 30 sec - exiting 13:33:13 (99580): No heartbeat from core client for 30 sec - exiting 13:33:14 (99580): No heartbeat from core client for 30 sec - exiting 13:33:15 (99580): No heartbeat from core client for 30 sec - exiting 13:33:16 (99580): No heartbeat from core client for 30 sec - exiting 13:33:17 (99580): No heartbeat from core client for 30 sec - exiting 13:33:18 (99580): No heartbeat from core client for 30 sec - exiting 13:33:20 (99580): No heartbeat from core client for 30 sec - exiting 13:33:21 (99580): No heartbeat from core client for 30 sec - exiting 13:33:22 (99580): No heartbeat from core client for 30 sec - exiting 13:33:23 (99580): No heartbeat from core client for 30 sec - exiting 13:33:24 (99580): No heartbeat from core client for 30 sec - exiting 13:33:25 (99580): No heartbeat from core client for 30 sec - exiting 13:33:26 (99580): No heartbeat from core client for 30 sec - exiting 13:33:27 (99580): No heartbeat from core client for 30 sec - exiting 13:33:28 (99580): No heartbeat from core client for 30 sec - exiting 13:33:29 (99580): No heartbeat from core client for 30 sec - exiting 13:33:30 (99580): No heartbeat from core client for 30 sec - exiting 13:33:32 (99580): No heartbeat from core client for 30 sec - exiting 13:33:33 (99580): No heartbeat from core client for 30 sec - exiting 13:33:34 (99580): No heartbeat from core client for 30 sec - exiting 13:33:35 (99580): No heartbeat from core client for 30 sec - exiting 13:33:36 (99580): No heartbeat from core client for 30 sec - exiting 13:33:37 (99580): No heartbeat from core client for 30 sec - exiting 13:33:38 (99580): No heartbeat from core client for 30 sec - exiting 13:33:39 (99580): No heartbeat from core client for 30 sec - exiting 13:33:40 (99580): No heartbeat from core client for 30 sec - exiting 13:33:41 (99580): No heartbeat from core client for 30 sec - exiting 13:33:42 (99580): No heartbeat from core client for 30 sec - exiting 13:33:44 (99580): No heartbeat from core client for 30 sec - exiting 13:33:45 (99580): No heartbeat from core client for 30 sec - exiting 13:33:46 (99580): No heartbeat from core client for 30 sec - exiting 13:33:47 (99580): No heartbeat from core client for 30 sec - exiting 13:33:48 (99580): No heartbeat from core client for 30 sec - exiting 13:33:49 (99580): No heartbeat from core client for 30 sec - exiting 13:33:50 (99580): No heartbeat from core client for 30 sec - exiting 13:33:51 (99580): No heartbeat from core client for 30 sec - exiting 13:33:52 (99580): No heartbeat from core client for 30 sec - exiting 13:33:53 (99580): No heartbeat from core client for 30 sec - exiting 13:33:54 (99580): No heartbeat from core client for 30 sec - exiting 13:33:56 (99580): No heartbeat from core client for 30 sec - exiting 13:33:57 (99580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:33:58 (99580): No heartbeat from core client for 30 sec - exiting 13:33:59 (99580): No heartbeat from core client for 30 sec - exiting 13:34:00 (99580): No heartbeat from core client for 30 sec - exiting 13:34:01 (99580): No heartbeat from core client for 30 sec - exiting 13:34:02 (99580): No heartbeat from core client for 30 sec - exiting 13:34:03 (99580): No heartbeat from core client for 30 sec - exiting 13:34:04 (99580): No heartbeat from core client for 30 sec - exiting 13:34:05 (99580): No heartbeat from core client for 30 sec - exiting 13:34:06 (99580): No heartbeat from core client for 30 sec - exiting 13:34:08 (99580): No heartbeat from core client for 30 sec - exiting 13:40:19 (99260): No heartbeat from core client for 30 sec - exiting 13:40:22 (99260): No heartbeat from core client for 30 sec - exiting 13:40:25 (99260): No heartbeat from core client for 30 sec - exiting 13:40:26 (99260): No heartbeat from core client for 30 sec - exiting 13:40:28 (99260): No heartbeat from core client for 30 sec - exiting 13:40:29 (99260): No heartbeat from core client for 30 sec - exiting 13:40:30 (99260): No heartbeat from core client for 30 sec - exiting 13:40:31 (99260): No heartbeat from core client for 30 sec - exiting 13:40:32 (99260): No heartbeat from core client for 30 sec - exiting 13:40:34 (99260): No heartbeat from core client for 30 sec - exiting 13:40:35 (99260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:40:36 (99260): No heartbeat from core client for 30 sec - exiting 13:40:39 (99260): No heartbeat from core client for 30 sec - exiting 13:42:30 (97752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:59:29 (100004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:30 (100004): No heartbeat from core client for 30 sec - exiting 13:59:31 (100004): No heartbeat from core client for 30 sec - exiting 13:59:33 (100004): No heartbeat from core client for 30 sec - exiting 13:59:34 (100004): No heartbeat from core client for 30 sec - exiting 13:59:35 (100004): No heartbeat from core client for 30 sec - exiting 13:59:36 (100004): No heartbeat from core client for 30 sec - exiting 13:59:37 (100004): No heartbeat from core client for 30 sec - exiting 13:59:38 (100004): No heartbeat from core client for 30 sec - exiting 13:59:39 (100004): No heartbeat from core client for 30 sec - exiting 13:59:40 (100004): No heartbeat from core client for 30 sec - exiting 14:01:00 (98740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:02:22 (98456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:36:59 (99860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:37:00 (99860): No heartbeat from core client for 30 sec - exiting 20:37:01 (99860): No heartbeat from core client for 30 sec - exiting 20:37:03 (99860): No heartbeat from core client for 30 sec - exiting 20:37:04 (99860): No heartbeat from core client for 30 sec - exiting 20:37:05 (99860): No heartbeat from core client for 30 sec - exiting 20:37:06 (99860): No heartbeat from core client for 30 sec - exiting 20:37:07 (99860): No heartbeat from core client for 30 sec - exiting 20:38:12 (99428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:34 (101004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:38:43 (101676): No heartbeat from core client for 30 sec - exiting 03:38:47 (101676): No heartbeat from core client for 30 sec - exiting 03:38:48 (101676): No heartbeat from core client for 30 sec - exiting 03:38:52 (101676): No heartbeat from core client for 30 sec - exiting 03:38:53 (101676): No heartbeat from core client for 30 sec - exiting 03:38:55 (101676): No heartbeat from core client for 30 sec - exiting 03:38:56 (101676): No heartbeat from core client for 30 sec - exiting 03:38:57 (101676): No heartbeat from core client for 30 sec - exiting 03:38:58 (101676): No heartbeat from core client for 30 sec - exiting 03:38:59 (101676): No heartbeat from core client for 30 sec - exiting 03:39:00 (101676): No heartbeat from core client for 30 sec - exiting 03:39:01 (101676): No heartbeat from core client for 30 sec - exiting 03:39:02 (101676): No heartbeat from core client for 30 sec - exiting 03:39:03 (101676): No heartbeat from core client for 30 sec - exiting 03:39:04 (101676): No heartbeat from core client for 30 sec - exiting 03:39:05 (101676): No heartbeat from core client for 30 sec - exiting 03:39:07 (101676): No heartbeat from core client for 30 sec - exiting 03:39:08 (101676): No heartbeat from core client for 30 sec - exiting 03:39:09 (101676): No heartbeat from core client for 30 sec - exiting 03:39:10 (101676): No heartbeat from core client for 30 sec - exiting 03:39:11 (101676): No heartbeat from core client for 30 sec - exiting 03:39:12 (101676): No heartbeat from core client for 30 sec - exiting 03:39:13 (101676): No heartbeat from core client for 30 sec - exiting 03:39:14 (101676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:15 (101676): No heartbeat from core client for 30 sec - exiting 03:39:16 (101676): No heartbeat from core client for 30 sec - exiting 03:39:18 (101676): No heartbeat from core client for 30 sec - exiting 03:39:19 (101676): No heartbeat from core client for 30 sec - exiting 03:39:20 (101676): No heartbeat from core client for 30 sec - exiting 03:39:21 (101676): No heartbeat from core client for 30 sec - exiting 03:39:22 (101676): No heartbeat from core client for 30 sec - exiting 03:39:23 (101676): No heartbeat from core client for 30 sec - exiting 03:39:24 (101676): No heartbeat from core client for 30 sec - exiting 03:41:45 (102328): No heartbeat from core client for 30 sec - exiting 03:41:46 (102328): No heartbeat from core client for 30 sec - exiting 03:41:47 (102328): No heartbeat from core client for 30 sec - exiting 03:41:48 (102328): No heartbeat from core client for 30 sec - exiting 03:41:49 (102328): No heartbeat from core client for 30 sec - exiting 03:41:50 (102328): No heartbeat from core client for 30 sec - exiting 03:41:52 (102328): No heartbeat from core client for 30 sec - exiting 03:41:54 (102328): No heartbeat from core client for 30 sec - exiting 03:41:55 (102328): No heartbeat from core client for 30 sec - exiting 03:41:56 (102328): No heartbeat from core client for 30 sec - exiting 03:41:57 (102328): No heartbeat from core client for 30 sec - exiting 03:41:58 (102328): No heartbeat from core client for 30 sec - exiting 03:41:59 (102328): No heartbeat from core client for 30 sec - exiting 03:42:02 (102328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:20 (102124): No heartbeat from core client for 30 sec - exiting 03:51:23 (102124): No heartbeat from core client for 30 sec - exiting 03:51:24 (102124): No heartbeat from core client for 30 sec - exiting 03:51:25 (102124): No heartbeat from core client for 30 sec - exiting 03:51:26 (102124): No heartbeat from core client for 30 sec - exiting 03:51:28 (102124): No heartbeat from core client for 30 sec - exiting 03:51:31 (102124): No heartbeat from core client for 30 sec - exiting 03:51:32 (102124): No heartbeat from core client for 30 sec - exiting 03:51:33 (102124): No heartbeat from core client for 30 sec - exiting 03:51:35 (102124): No heartbeat from core client for 30 sec - exiting 03:51:36 (102124): No heartbeat from core client for 30 sec - exiting 03:51:37 (102124): No heartbeat from core client for 30 sec - exiting 03:51:38 (102124): No heartbeat from core client for 30 sec - exiting 03:51:39 (102124): No heartbeat from core client for 30 sec - exiting 03:51:40 (102124): No heartbeat from core client for 30 sec - exiting 03:51:44 (102124): No heartbeat from core client for 30 sec - exiting 03:51:47 (102124): No heartbeat from core client for 30 sec - exiting 03:51:48 (102124): No heartbeat from core client for 30 sec - exiting 03:51:49 (102124): No heartbeat from core client for 30 sec - exiting 03:51:50 (102124): No heartbeat from core client for 30 sec - exiting 03:51:52 (102124): No heartbeat from core client for 30 sec - exiting 03:51:55 (102124): No heartbeat from core client for 30 sec - exiting 03:51:56 (102124): No heartbeat from core client for 30 sec - exiting 03:51:57 (102124): No heartbeat from core client for 30 sec - exiting 03:51:58 (102124): No heartbeat from core client for 30 sec - exiting 03:52:00 (102124): No heartbeat from core client for 30 sec - exiting 03:52:02 (102124): No heartbeat from core client for 30 sec - exiting 03:52:05 (102124): No heartbeat from core client for 30 sec - exiting 03:52:06 (102124): No heartbeat from core client for 30 sec - exiting 03:52:07 (102124): No heartbeat from core client for 30 sec - exiting 03:52:09 (102124): No heartbeat from core client for 30 sec - exiting 03:52:10 (102124): No heartbeat from core client for 30 sec - exiting 03:52:12 (102124): No heartbeat from core client for 30 sec - exiting 03:52:15 (102124): No heartbeat from core client for 30 sec - exiting 03:52:17 (102124): No heartbeat from core client for 30 sec - exiting 03:52:18 (102124): No heartbeat from core client for 30 sec - exiting 03:52:19 (102124): No heartbeat from core client for 30 sec - exiting 03:52:20 (102124): No heartbeat from core client for 30 sec - exiting 03:52:22 (102124): No heartbeat from core client for 30 sec - exiting 03:52:23 (102124): No heartbeat from core client for 30 sec - exiting 03:52:24 (102124): No heartbeat from core client for 30 sec - exiting 03:52:26 (102124): No heartbeat from core client for 30 sec - exiting 03:52:27 (102124): No heartbeat from core client for 30 sec - exiting 03:52:28 (102124): No heartbeat from core client for 30 sec - exiting 03:52:29 (102124): No heartbeat from core client for 30 sec - exiting 03:52:30 (102124): No heartbeat from core client for 30 sec - exiting 03:52:31 (102124): No heartbeat from core client for 30 sec - exiting 03:52:32 (102124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:55:31 (102144): No heartbeat from core client for 30 sec - exiting 03:55:32 (102144): No heartbeat from core client for 30 sec - exiting 03:55:33 (102144): No heartbeat from core client for 30 sec - exiting 03:55:35 (102144): No heartbeat from core client for 30 sec - exiting 03:55:36 (102144): No heartbeat from core client for 30 sec - exiting 03:55:38 (102144): No heartbeat from core client for 30 sec - exiting 03:55:39 (102144): No heartbeat from core client for 30 sec - exiting 03:55:40 (102144): No heartbeat from core client for 30 sec - exiting 03:55:41 (102144): No heartbeat from core client for 30 sec - exiting 03:55:43 (102144): No heartbeat from core client for 30 sec - exiting 03:55:44 (102144): No heartbeat from core client for 30 sec - exiting 03:55:45 (102144): No heartbeat from core client for 30 sec - exiting Could not launch model process. Last Error=5 Called boinc_finish 03:58:18 (102144): No heartbeat from core client for 30 sec - exiting 03:58:19 (102144): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Sep 2013 02:32:02	1127359	16011328	hadcm3n_o3i1_1980_40_008407800_1	25,920	43,822	1.6907