Task 18760144

Name	hadcm3n_sd4i_1980_40_010022096_1
Workunit	10020166
Created	10 Aug 2015, 15:00:48 UTC
Sent	10 Aug 2015, 15:00:54 UTC
Report deadline	9 Nov 2015, 22:28:05 UTC
Received	18 Aug 2015, 12:13:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-2 (0xFFFFFFFE) Unknown error code
Computer ID	1352108
Run time	4 days 9 hours 56 min 56 sec
CPU time	3 days 18 hours 19 min 57 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	3.30 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <message> (unknown error) - exit code -2 (0xfffffffe) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:35:14 (3916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:35:20 (3916): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:13:54 (6476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:46 (6476): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Ocean Restart file copy failed on sd4iko.dai23k0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:55:18 (1316): No heartbeat from core client for 30 sec - exiting 12:55:19 (1316): No heartbeat from core client for 30 sec - exiting 12:55:20 (1316): No heartbeat from core client for 30 sec - exiting 12:55:21 (1316): No heartbeat from core client for 30 sec - exiting 12:55:22 (1316): No heartbeat from core client for 30 sec - exiting 12:55:23 (1316): No heartbeat from core client for 30 sec - exiting 12:55:24 (1316): No heartbeat from core client for 30 sec - exiting 12:55:25 (1316): No heartbeat from core client for 30 sec - exiting 12:55:26 (1316): No heartbeat from core client for 30 sec - exiting 12:55:27 (1316): No heartbeat from core client for 30 sec - exiting 12:55:28 (1316): No heartbeat from core client for 30 sec - exiting 12:55:29 (1316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:55:30 (1316): No heartbeat from core client for 30 sec - exiting 13:16:46 (4444): No heartbeat from core client for 30 sec - exiting 13:16:47 (4444): No heartbeat from core client for 30 sec - exiting 13:16:48 (4444): No heartbeat from core client for 30 sec - exiting 13:16:49 (4444): No heartbeat from core client for 30 sec - exiting 13:16:50 (4444): No heartbeat from core client for 30 sec - exiting 13:16:51 (4444): No heartbeat from core client for 30 sec - exiting 13:16:52 (4444): No heartbeat from core client for 30 sec - exiting 13:16:53 (4444): No heartbeat from core client for 30 sec - exiting 13:16:54 (4444): No heartbeat from core client for 30 sec - exiting 13:16:55 (4444): No heartbeat from core client for 30 sec - exiting 13:16:56 (4444): No heartbeat from core client for 30 sec - exiting 13:16:57 (4444): No heartbeat from core client for 30 sec - exiting 13:16:58 (4444): No heartbeat from core client for 30 sec - exiting 13:16:59 (4444): No heartbeat from core client for 30 sec - exiting 13:17:00 (4444): No heartbeat from core client for 30 sec - exiting 13:17:01 (4444): No heartbeat from core client for 30 sec - exiting 13:17:02 (4444): No heartbeat from core client for 30 sec - exiting 13:17:03 (4444): No heartbeat from core client for 30 sec - exiting 13:17:04 (4444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:56:42 (3252): No heartbeat from core client for 30 sec - exiting 13:56:43 (3252): No heartbeat from core client for 30 sec - exiting 13:56:44 (3252): No heartbeat from core client for 30 sec - exiting 13:56:45 (3252): No heartbeat from core client for 30 sec - exiting 13:56:46 (3252): No heartbeat from core client for 30 sec - exiting 13:56:47 (3252): No heartbeat from core client for 30 sec - exiting 13:56:48 (3252): No heartbeat from core client for 30 sec - exiting 13:56:49 (3252): No heartbeat from core client for 30 sec - exiting 13:56:50 (3252): No heartbeat from core client for 30 sec - exiting 13:56:51 (3252): No heartbeat from core client for 30 sec - exiting 13:56:52 (3252): No heartbeat from core client for 30 sec - exiting 13:56:53 (3252): No heartbeat from core client for 30 sec - exiting 13:56:54 (3252): No heartbeat from core client for 30 sec - exiting 13:56:55 (3252): No heartbeat from core client for 30 sec - exiting 13:56:56 (3252): No heartbeat from core client for 30 sec - exiting 13:56:57 (3252): No heartbeat from core client for 30 sec - exiting 13:56:58 (3252): No heartbeat from core client for 30 sec - exiting 13:56:59 (3252): No heartbeat from core client for 30 sec - exiting 13:57:00 (3252): No heartbeat from core client for 30 sec - exiting 13:57:01 (3252): No heartbeat from core client for 30 sec - exiting 13:57:02 (3252): No heartbeat from core client for 30 sec - exiting 13:57:03 (3252): No heartbeat from core client for 30 sec - exiting 13:57:04 (3252): No heartbeat from core client for 30 sec - exiting 13:57:05 (3252): No heartbeat from core client for 30 sec - exiting 13:57:06 (3252): No heartbeat from core client for 30 sec - exiting 13:57:07 (3252): No heartbeat from core client for 30 sec - exiting 13:57:08 (3252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:03 (3660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:27:58 (4324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:59 (4324): No heartbeat from core client for 30 sec - exiting 16:28:00 (4324): No heartbeat from core client for 30 sec - exiting 16:28:01 (4324): No heartbeat from core client for 30 sec - exiting 16:28:02 (4324): No heartbeat from core client for 30 sec - exiting 16:28:03 (4324): No heartbeat from core client for 30 sec - exiting 16:28:04 (4324): No heartbeat from core client for 30 sec - exiting 16:28:05 (4324): No heartbeat from core client for 30 sec - exiting 16:28:06 (4324): No heartbeat from core client for 30 sec - exiting 16:28:07 (4324): No heartbeat from core client for 30 sec - exiting 16:28:08 (4324): No heartbeat from core client for 30 sec - exiting 16:28:09 (4324): No heartbeat from core client for 30 sec - exiting 16:28:10 (4324): No heartbeat from core client for 30 sec - exiting 16:28:11 (4324): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:03:58 (4484): No heartbeat from core client for 30 sec - exiting 19:03:59 (4484): No heartbeat from core client for 30 sec - exiting 19:04:00 (4484): No heartbeat from core client for 30 sec - exiting 19:04:02 (4484): No heartbeat from core client for 30 sec - exiting 19:04:03 (4484): No heartbeat from core client for 30 sec - exiting 19:04:04 (4484): No heartbeat from core client for 30 sec - exiting 19:04:05 (4484): No heartbeat from core client for 30 sec - exiting 19:04:06 (4484): No heartbeat from core client for 30 sec - exiting 19:04:07 (4484): No heartbeat from core client for 30 sec - exiting 19:04:08 (4484): No heartbeat from core client for 30 sec - exiting 19:04:09 (4484): No heartbeat from core client for 30 sec - exiting 19:04:10 (4484): No heartbeat from core client for 30 sec - exiting 19:04:11 (4484): No heartbeat from core client for 30 sec - exiting 19:04:12 (4484): No heartbeat from core client for 30 sec - exiting 19:04:13 (4484): No heartbeat from core client for 30 sec - exiting 19:04:14 (4484): No heartbeat from core client for 30 sec - exiting 19:04:15 (4484): No heartbeat from core client for 30 sec - exiting 19:04:16 (4484): No heartbeat from core client for 30 sec - exiting 19:04:17 (4484): No heartbeat from core client for 30 sec - exiting 19:04:18 (4484): No heartbeat from core client for 30 sec - exiting 19:04:19 (4484): No heartbeat from core client for 30 sec - exiting 19:04:20 (4484): No heartbeat from core client for 30 sec - exiting 19:04:21 (4484): No heartbeat from core client for 30 sec - exiting 19:04:22 (4484): No heartbeat from core client for 30 sec - exiting 19:04:23 (4484): No heartbeat from core client for 30 sec - exiting 19:04:24 (4484): No heartbeat from core client for 30 sec - exiting 19:04:25 (4484): No heartbeat from core client for 30 sec - exiting 19:04:26 (4484): No heartbeat from core client for 30 sec - exiting 19:04:27 (4484): No heartbeat from core client for 30 sec - exiting 19:04:28 (4484): No heartbeat from core client for 30 sec - exiting 19:04:29 (4484): No heartbeat from core client for 30 sec - exiting 19:04:30 (4484): No heartbeat from core client for 30 sec - exiting 19:04:31 (4484): No heartbeat from core client for 30 sec - exiting 19:04:32 (4484): No heartbeat from core client for 30 sec - exiting 19:04:33 (4484): No heartbeat from core client for 30 sec - exiting 19:04:34 (4484): No heartbeat from core client for 30 sec - exiting 19:04:35 (4484): No heartbeat from core client for 30 sec - exiting 19:04:36 (4484): No heartbeat from core client for 30 sec - exiting 19:04:37 (4484): No heartbeat from core client for 30 sec - exiting 19:04:38 (4484): No heartbeat from core client for 30 sec - exiting 19:04:39 (4484): No heartbeat from core client for 30 sec - exiting 19:04:40 (4484): No heartbeat from core client for 30 sec - exiting 19:04:41 (4484): No heartbeat from core client for 30 sec - exiting 19:04:42 (4484): No heartbeat from core client for 30 sec - exiting 19:04:43 (4484): No heartbeat from core client for 30 sec - exiting 19:04:44 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:47:50 (4692): No heartbeat from core client for 30 sec - exiting 19:47:51 (4692): No heartbeat from core client for 30 sec - exiting 19:47:52 (4692): No heartbeat from core client for 30 sec - exiting 19:47:53 (4692): No heartbeat from core client for 30 sec - exiting 19:47:54 (4692): No heartbeat from core client for 30 sec - exiting 19:47:55 (4692): No heartbeat from core client for 30 sec - exiting 19:47:56 (4692): No heartbeat from core client for 30 sec - exiting 19:47:57 (4692): No heartbeat from core client for 30 sec - exiting 19:47:58 (4692): No heartbeat from core client for 30 sec - exiting 19:47:59 (4692): No heartbeat from core client for 30 sec - exiting 19:48:00 (4692): No heartbeat from core client for 30 sec - exiting 19:48:01 (4692): No heartbeat from core client for 30 sec - exiting 19:48:02 (4692): No heartbeat from core client for 30 sec - exiting 19:48:03 (4692): No heartbeat from core client for 30 sec - exiting 19:48:04 (4692): No heartbeat from core client for 30 sec - exiting 19:48:05 (4692): No heartbeat from core client for 30 sec - exiting 19:48:06 (4692): No heartbeat from core client for 30 sec - exiting 19:48:07 (4692): No heartbeat from core client for 30 sec - exiting 19:48:08 (4692): No heartbeat from core client for 30 sec - exiting 19:48:09 (4692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:52:57 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:01:39 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:01:40 (5772): No heartbeat from core client for 30 sec - exiting 07:01:41 (5772): No heartbeat from core client for 30 sec - exiting 07:01:42 (5772): No heartbeat from core client for 30 sec - exiting 07:01:43 (5772): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:01:02 (6116): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:01:15 (6116): No heartbeat from core client for 30 sec - exiting 12:01:16 (6116): No heartbeat from core client for 30 sec - exiting 12:01:17 (6116): No heartbeat from core client for 30 sec - exiting 12:01:18 (6116): No heartbeat from core client for 30 sec - exiting 12:01:19 (6116): No heartbeat from core client for 30 sec - exiting 12:01:21 (6116): No heartbeat from core client for 30 sec - exiting 12:01:22 (6116): No heartbeat from core client for 30 sec - exiting 12:01:23 (6116): No heartbeat from core client for 30 sec - exiting 12:01:24 (6116): No heartbeat from core client for 30 sec - exiting 12:01:25 (6116): No heartbeat from core client for 30 sec - exiting 12:01:27 (6116): No heartbeat from core client for 30 sec - exiting 12:01:31 (6116): No heartbeat from core client for 30 sec - exiting 12:01:32 (6116): No heartbeat from core client for 30 sec - exiting 12:01:37 (6116): No heartbeat from core client for 30 sec - exiting 12:01:38 (6116): No heartbeat from core client for 30 sec - exiting 12:01:39 (6116): No heartbeat from core client for 30 sec - exiting 12:01:40 (6116): No heartbeat from core client for 30 sec - exiting 12:01:41 (6116): No heartbeat from core client for 30 sec - exiting 12:01:42 (6116): No heartbeat from core client for 30 sec - exiting 12:01:43 (6116): No heartbeat from core client for 30 sec - exiting 12:01:44 (6116): No heartbeat from core client for 30 sec - exiting 12:01:45 (6116): No heartbeat from core client for 30 sec - exiting 12:01:46 (6116): No heartbeat from core client for 30 sec - exiting 12:01:47 (6116): No heartbeat from core client for 30 sec - exiting 12:01:48 (6116): No heartbeat from core client for 30 sec - exiting 12:01:49 (6116): No heartbeat from core client for 30 sec - exiting 12:01:50 (6116): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:46:07 (3248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:59:34 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:14:50 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:16:34 (4824): No heartbeat from core client for 30 sec - exiting 06:16:35 (4824): No heartbeat from core client for 30 sec - exiting 06:16:36 (4824): No heartbeat from core client for 30 sec - exiting 06:16:37 (4824): No heartbeat from core client for 30 sec - exiting 06:16:38 (4824): No heartbeat from core client for 30 sec - exiting 06:16:39 (4824): No heartbeat from core client for 30 sec - exiting 06:16:40 (4824): No heartbeat from core client for 30 sec - exiting 06:16:41 (4824): No heartbeat from core client for 30 sec - exiting 06:16:42 (4824): No heartbeat from core client for 30 sec - exiting 06:16:43 (4824): No heartbeat from core client for 30 sec - exiting 06:16:44 (4824): No heartbeat from core client for 30 sec - exiting 06:16:45 (4824): No heartbeat from core client for 30 sec - exiting 06:16:46 (4824): No heartbeat from core client for 30 sec - exiting 06:16:47 (4824): No heartbeat from core client for 30 sec - exiting 06:16:48 (4824): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:15:00 (5592): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 04:15:01 (5592): No heartbeat from core client for 30 sec - exiting 04:15:02 (5592): No heartbeat from core client for 30 sec - exiting 04:15:03 (5592): No heartbeat from core client for 30 sec - exiting 04:15:04 (5592): No heartbeat from core client for 30 sec - exiting 04:15:05 (5592): No heartbeat from core client for 30 sec - exiting 04:15:06 (5592): No heartbeat from core client for 30 sec - exiting 04:15:07 (5592): No heartbeat from core client for 30 sec - exiting 04:15:08 (5592): No heartbeat from core client for 30 sec - exiting 04:15:09 (5592): No heartbeat from core client for 30 sec - exiting 04:15:10 (5592): No heartbeat from core client for 30 sec - exiting 04:15:11 (5592): No heartbeat from core client for 30 sec - exiting 04:15:12 (5592): No heartbeat from core client for 30 sec - exiting 04:15:13 (5592): No heartbeat from core client for 30 sec - exiting 04:15:14 (5592): No heartbeat from core client for 30 sec - exiting 04:15:15 (5592): No heartbeat from core client for 30 sec - exiting 04:15:16 (5592): No heartbeat from core client for 30 sec - exiting 04:15:17 (5592): No heartbeat from core client for 30 sec - exiting 04:15:18 (5592): No heartbeat from core client for 30 sec - exiting 04:15:19 (5592): No heartbeat from core client for 30 sec - exiting 04:15:20 (5592): No heartbeat from core client for 30 sec - exiting 04:15:21 (5592): No heartbeat from core client for 30 sec - exiting 04:15:22 (5592): No heartbeat from core client for 30 sec - exiting 04:15:23 (5592): No heartbeat from core client for 30 sec - exiting 04:15:24 (5592): No heartbeat from core client for 30 sec - exiting 04:15:25 (5592): No heartbeat from core client for 30 sec - exiting 04:15:26 (5592): No heartbeat from core client for 30 sec - exiting 04:15:27 (5592): No heartbeat from core client for 30 sec - exiting 04:15:28 (5592): No heartbeat from core client for 30 sec - exiting 04:15:29 (5592): No heartbeat from core client for 30 sec - exiting 04:15:30 (5592): No heartbeat from core client for 30 sec - exiting 04:15:31 (5592): No heartbeat from core client for 30 sec - exiting 04:15:32 (5592): No heartbeat from core client for 30 sec - exiting 04:15:33 (5592): No heartbeat from core client for 30 sec - exiting 04:15:34 (5592): No heartbeat from core client for 30 sec - exiting 04:15:35 (5592): No heartbeat from core client for 30 sec - exiting 04:15:36 (5592): No heartbeat from core client for 30 sec - exiting 04:15:37 (5592): No heartbeat from core client for 30 sec - exiting 04:15:38 (5592): No heartbeat from core client for 30 sec - exiting 04:15:39 (5592): No heartbeat from core client for 30 sec - exiting 04:15:40 (5592): No heartbeat from core client for 30 sec - exiting 04:15:41 (5592): No heartbeat from core client for 30 sec - exiting 04:15:42 (5592): No heartbeat from core client for 30 sec - exiting 04:15:43 (5592): No heartbeat from core client for 30 sec - exiting 04:16:01 (5592): No heartbeat from core client for 30 sec - exiting 04:16:02 (5592): No heartbeat from core client for 30 sec - exiting 04:16:03 (5592): No heartbeat from core client for 30 sec - exiting 04:16:04 (5592): No heartbeat from core client for 30 sec - exiting 04:16:05 (5592): No heartbeat from core client for 30 sec - exiting 04:16:06 (5592): No heartbeat from core client for 30 sec - exiting 04:16:07 (5592): No heartbeat from core client for 30 sec - exiting 04:16:08 (5592): No heartbeat from core client for 30 sec - exiting 04:16:09 (5592): No heartbeat from core client for 30 sec - exiting 04:16:10 (5592): No heartbeat from core client for 30 sec - exiting 04:16:11 (5592): No heartbeat from core client for 30 sec - exiting 04:16:12 (5592): No heartbeat from core client for 30 sec - exiting 04:16:13 (5592): No heartbeat from core client for 30 sec - exiting 04:16:14 (5592): No heartbeat from core client for 30 sec - exiting 04:16:15 (5592): No heartbeat from core client for 30 sec - exiting 04:16:16 (5592): No heartbeat from core client for 30 sec - exiting 04:16:17 (5592): No heartbeat from core client for 30 sec - exiting 04:16:35 (5592): No heartbeat from core client for 30 sec - exiting 04:16:36 (5592): No heartbeat from core client for 30 sec - exiting 04:16:37 (5592): No heartbeat from core client for 30 sec - exiting 04:16:38 (5592): No heartbeat from core client for 30 sec - exiting 04:16:39 (5592): No heartbeat from core client for 30 sec - exiting 04:16:40 (5592): No heartbeat from core client for 30 sec - exiting 04:16:41 (5592): No heartbeat from core client for 30 sec - exiting 04:16:42 (5592): No heartbeat from core client for 30 sec - exiting 04:16:43 (5592): No heartbeat from core client for 30 sec - exiting 04:16:44 (5592): No heartbeat from core client for 30 sec - exiting 04:16:45 (5592): No heartbeat from core client for 30 sec - exiting 04:16:46 (5592): No heartbeat from core client for 30 sec - exiting 04:16:47 (5592): No heartbeat from core client for 30 sec - exiting 04:16:48 (5592): No heartbeat from core client for 30 sec - exiting 04:16:49 (5592): No heartbeat from core client for 30 sec - exiting 04:16:50 (5592): No heartbeat from core client for 30 sec - exiting 04:16:51 (5592): No heartbeat from core client for 30 sec - exiting 04:16:52 (5592): No heartbeat from core client for 30 sec - exiting 04:16:53 (5592): No heartbeat from core client for 30 sec - exiting 04:16:54 (5592): No heartbeat from core client for 30 sec - exiting 04:16:55 (5592): No heartbeat from core client for 30 sec - exiting 04:16:56 (5592): No heartbeat from core client for 30 sec - exiting 04:16:57 (5592): No heartbeat from core client for 30 sec - exiting 04:16:58 (5592): No heartbeat from core client for 30 sec - exiting 04:16:59 (5592): No heartbeat from core client for 30 sec - exiting 04:17:00 (5592): No heartbeat from core client for 30 sec - exiting 04:17:01 (5592): No heartbeat from core client for 30 sec - exiting 04:17:02 (5592): No heartbeat from core client for 30 sec - exiting 04:17:03 (5592): No heartbeat from core client for 30 sec - exiting 04:17:04 (5592): No heartbeat from core client for 30 sec - exiting 04:17:05 (5592): No heartbeat from core client for 30 sec - exiting 04:17:06 (5592): No heartbeat from core client for 30 sec - exiting 04:17:07 (5592): No heartbeat from core client for 30 sec - exiting 04:17:08 (5592): No heartbeat from core client for 30 sec - exiting 04:17:09 (5592): No heartbeat from core client for 30 sec - exiting 04:17:10 (5592): No heartbeat from core client for 30 sec - exiting 04:17:11 (5592): No heartbeat from core client for 30 sec - exiting 04:17:12 (5592): No heartbeat from core client for 30 sec - exiting 04:17:13 (5592): No heartbeat from core client for 30 sec - exiting 04:17:14 (5592): No heartbeat from core client for 30 sec - exiting 04:17:15 (5592): No heartbeat from core client for 30 sec - exiting 04:17:16 (5592): No heartbeat from core client for 30 sec - exiting 04:17:17 (5592): No heartbeat from core client for 30 sec - exiting 04:17:18 (5592): No heartbeat from core client for 30 sec - exiting 04:17:19 (5592): No heartbeat from core client for 30 sec - exiting 04:17:20 (5592): No heartbeat from core client for 30 sec - exiting 04:17:21 (5592): No heartbeat from core client for 30 sec - exiting 04:17:22 (5592): No heartbeat from core client for 30 sec - exiting 04:17:23 (5592): No heartbeat from core client for 30 sec - exiting 04:17:24 (5592): No heartbeat from core client for 30 sec - exiting 04:17:25 (5592): No heartbeat from core client for 30 sec - exiting 04:17:26 (5592): No heartbeat from core client for 30 sec - exiting 04:17:27 (5592): No heartbeat from core client for 30 sec - exiting 04:17:28 (5592): No heartbeat from core client for 30 sec - exiting 04:17:29 (5592): No heartbeat from core client for 30 sec - exiting 04:17:30 (5592): No heartbeat from core client for 30 sec - exiting 04:17:31 (5592): No heartbeat from core client for 30 sec - exiting 04:17:32 (5592): No heartbeat from core client for 30 sec - exiting 04:17:33 (5592): No heartbeat from core client for 30 sec - exiting 04:17:34 (5592): No heartbeat from core client for 30 sec - exiting 04:17:35 (5592): No heartbeat from core client for 30 sec - exiting 04:17:36 (5592): No heartbeat from core client for 30 sec - exiting 04:17:37 (5592): No heartbeat from core client for 30 sec - exiting 04:17:38 (5592): No heartbeat from core client for 30 sec - exiting 04:17:39 (5592): No heartbeat from core client for 30 sec - exiting 04:17:40 (5592): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:42:54 (6720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:20 (6720): No heartbeat from core client for 30 sec - exiting 17:43:21 (6720): No heartbeat from core client for 30 sec - exiting 17:43:22 (6720): No heartbeat from core client for 30 sec - exiting 17:43:23 (6720): No heartbeat from core client for 30 sec - exiting 17:43:24 (6720): No heartbeat from core client for 30 sec - exiting 17:43:25 (6720): No heartbeat from core client for 30 sec - exiting 17:43:26 (6720): No heartbeat from core client for 30 sec - exiting 17:43:27 (6720): No heartbeat from core client for 30 sec - exiting 17:43:28 (6720): No heartbeat from core client for 30 sec - exiting 17:43:29 (6720): No heartbeat from core client for 30 sec - exiting 17:43:30 (6720): No heartbeat from core client for 30 sec - exiting 17:43:31 (6720): No heartbeat from core client for 30 sec - exiting 17:43:32 (6720): No heartbeat from core client for 30 sec - exiting 17:43:33 (6720): No heartbeat from core client for 30 sec - exiting 17:43:34 (6720): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Ocean Restart file copy failed on sd4iko.dai9al0 17:59:24 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:02:17 (6692): No heartbeat from core client for 30 sec - exiting 18:04:47 (7544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5532, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5532, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5532, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5532, iMonCtr=1 Model crash detected, will try to restart... Could not launch model process. Last Error=1450 Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Aug 2015 05:48:01	1352108	18760144	hadcm3n_sd4i_1980_40_010022096_1	207,360	290,735	1.4021
16 Aug 2015 18:29:09	1352108	18760144	hadcm3n_sd4i_1980_40_010022096_1	181,440	254,590	1.4032
15 Aug 2015 17:33:17	1352108	18760144	hadcm3n_sd4i_1980_40_010022096_1	155,520	217,289	1.3972
15 Aug 2015 03:37:35	1352108	18760144	hadcm3n_sd4i_1980_40_010022096_1	129,600	181,035	1.3969
13 Aug 2015 23:27:53	1352108	18760144	hadcm3n_sd4i_1980_40_010022096_1	103,680	144,316	1.3919
13 Aug 2015 04:06:33	1352108	18760144	hadcm3n_sd4i_1980_40_010022096_1	77,760	107,612	1.3839
12 Aug 2015 09:44:10	1352108	18760144	hadcm3n_sd4i_1980_40_010022096_1	51,840	71,156	1.3726
11 Aug 2015 10:26:22	1352108	18760144	hadcm3n_sd4i_1980_40_010022096_1	25,920	35,502	1.3697