Task 15845022

Name	hadcm3n_4hf4_1980_40_008390334_2
Workunit	8541193
Created	16 Jun 2013, 16:05:37 UTC
Sent	16 Jun 2013, 17:07:05 UTC
Report deadline	16 Sep 2013, 0:34:16 UTC
Received	20 Jul 2013, 7:54:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1292103
Run time	8 days 14 hours 40 min 54 sec
CPU time	8 days 0 hours 45 min 38 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 07:59:49 (11540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:15:15 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:17 (3260): No heartbeat from core client for 30 sec - exiting 18:15:18 (3260): No heartbeat from core client for 30 sec - exiting 18:17:13 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:57:37 (27896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:38 (23108): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:12:08 (16884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:12:05 (13072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:42:01 (6256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:42:03 (6256): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:20:22 (18112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:59 (22868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:58:00 (22868): No heartbeat from core client for 30 sec - exiting 15:20:41 (472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:42 (472): No heartbeat from core client for 30 sec - exiting 15:20:43 (472): No heartbeat from core client for 30 sec - exiting 15:55:01 (17740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:04 (17740): No heartbeat from core client for 30 sec - exiting 15:55:05 (17740): No heartbeat from core client for 30 sec - exiting 15:55:06 (17740): No heartbeat from core client for 30 sec - exiting 16:20:41 (22504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:20:43 (22504): No heartbeat from core client for 30 sec - exiting 16:20:44 (22504): No heartbeat from core client for 30 sec - exiting 16:20:45 (22504): No heartbeat from core client for 30 sec - exiting 16:20:46 (22504): No heartbeat from core client for 30 sec - exiting 16:20:47 (22504): No heartbeat from core client for 30 sec - exiting 16:20:48 (22504): No heartbeat from core client for 30 sec - exiting 16:20:49 (22504): No heartbeat from core client for 30 sec - exiting 16:20:50 (22504): No heartbeat from core client for 30 sec - exiting 16:20:51 (22504): No heartbeat from core client for 30 sec - exiting 16:20:52 (22504): No heartbeat from core client for 30 sec - exiting 16:20:53 (22504): No heartbeat from core client for 30 sec - exiting 16:22:10 (24536): No heartbeat from core client for 30 sec - exiting 16:22:11 (24536): No heartbeat from core client for 30 sec - exiting 16:22:12 (24536): No heartbeat from core client for 30 sec - exiting 16:22:13 (24536): No heartbeat from core client for 30 sec - exiting 16:22:14 (24536): No heartbeat from core client for 30 sec - exiting 16:22:15 (24536): No heartbeat from core client for 30 sec - exiting 16:22:16 (24536): No heartbeat from core client for 30 sec - exiting 16:22:17 (24536): No heartbeat from core client for 30 sec - exiting 16:22:18 (24536): No heartbeat from core client for 30 sec - exiting 16:22:19 (24536): No heartbeat from core client for 30 sec - exiting 16:22:20 (24536): No heartbeat from core client for 30 sec - exiting 16:22:21 (24536): No heartbeat from core client for 30 sec - exiting 16:22:22 (24536): No heartbeat from core client for 30 sec - exiting 16:22:23 (24536): No heartbeat from core client for 30 sec - exiting 16:22:24 (24536): No heartbeat from core client for 30 sec - exiting 16:22:25 (24536): No heartbeat from core client for 30 sec - exiting 16:22:26 (24536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:27:41 (22752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:27:42 (22752): No heartbeat from core client for 30 sec - exiting 17:41:34 (19436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:56:18 (24504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:56:19 (24504): No heartbeat from core client for 30 sec - exiting 18:37:24 (25532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:26 (25532): No heartbeat from core client for 30 sec - exiting 18:37:27 (25532): No heartbeat from core client for 30 sec - exiting 18:37:28 (25532): No heartbeat from core client for 30 sec - exiting 18:48:47 (24780): No heartbeat from core client for 30 sec - exiting 18:49:18 (24780): No heartbeat from core client for 30 sec - exiting 18:49:19 (24780): No heartbeat from core client for 30 sec - exiting 18:49:20 (24780): No heartbeat from core client for 30 sec - exiting 18:49:21 (24780): No heartbeat from core client for 30 sec - exiting 18:49:22 (24780): No heartbeat from core client for 30 sec - exiting 18:49:23 (24780): No heartbeat from core client for 30 sec - exiting 18:49:24 (24780): No heartbeat from core client for 30 sec - exiting 18:49:25 (24780): No heartbeat from core client for 30 sec - exiting 18:49:26 (24780): No heartbeat from core client for 30 sec - exiting 18:49:27 (24780): No heartbeat from core client for 30 sec - exiting 18:49:28 (24780): No heartbeat from core client for 30 sec - exiting 18:49:29 (24780): No heartbeat from core client for 30 sec - exiting 18:49:30 (24780): No heartbeat from core client for 30 sec - exiting 18:49:31 (24780): No heartbeat from core client for 30 sec - exiting 18:49:32 (24780): No heartbeat from core client for 30 sec - exiting 18:49:33 (24780): No heartbeat from core client for 30 sec - exiting 18:49:34 (24780): No heartbeat from core client for 30 sec - exiting 18:49:35 (24780): No heartbeat from core client for 30 sec - exiting 18:49:36 (24780): No heartbeat from core client for 30 sec - exiting 18:49:37 (24780): No heartbeat from core client for 30 sec - exiting 18:49:38 (24780): No heartbeat from core client for 30 sec - exiting 18:49:39 (24780): No heartbeat from core client for 30 sec - exiting 18:49:40 (24780): No heartbeat from core client for 30 sec - exiting 18:49:41 (24780): No heartbeat from core client for 30 sec - exiting 18:49:42 (24780): No heartbeat from core client for 30 sec - exiting 18:49:43 (24780): No heartbeat from core client for 30 sec - exiting 18:49:44 (24780): No heartbeat from core client for 30 sec - exiting 18:49:45 (24780): No heartbeat from core client for 30 sec - exiting 18:49:46 (24780): No heartbeat from core client for 30 sec - exiting 18:49:47 (24780): No heartbeat from core client for 30 sec - exiting 18:49:48 (24780): No heartbeat from core client for 30 sec - exiting 18:49:49 (24780): No heartbeat from core client for 30 sec - exiting 18:49:50 (24780): No heartbeat from core client for 30 sec - exiting 18:49:51 (24780): No heartbeat from core client for 30 sec - exiting 18:49:52 (24780): No heartbeat from core client for 30 sec - exiting 18:49:53 (24780): No heartbeat from core client for 30 sec - exiting 18:49:54 (24780): No heartbeat from core client for 30 sec - exiting 18:49:55 (24780): No heartbeat from core client for 30 sec - exiting 18:49:56 (24780): No heartbeat from core client for 30 sec - exiting 18:49:57 (24780): No heartbeat from core client for 30 sec - exiting 18:49:58 (24780): No heartbeat from core client for 30 sec - exiting 18:49:59 (24780): No heartbeat from core client for 30 sec - exiting 18:50:00 (24780): No heartbeat from core client for 30 sec - exiting 18:50:01 (24780): No heartbeat from core client for 30 sec - exiting 18:50:02 (24780): No heartbeat from core client for 30 sec - exiting 18:50:03 (24780): No heartbeat from core client for 30 sec - exiting 18:50:04 (24780): No heartbeat from core client for 30 sec - exiting 18:50:05 (24780): No heartbeat from core client for 30 sec - exiting 18:50:06 (24780): No heartbeat from core client for 30 sec - exiting 18:50:07 (24780): No heartbeat from core client for 30 sec - exiting 18:50:08 (24780): No heartbeat from core client for 30 sec - exiting 18:50:09 (24780): No heartbeat from core client for 30 sec - exiting 18:50:10 (24780): No heartbeat from core client for 30 sec - exiting 18:50:11 (24780): No heartbeat from core client for 30 sec - exiting 18:50:12 (24780): No heartbeat from core client for 30 sec - exiting 18:50:13 (24780): No heartbeat from core client for 30 sec - exiting 18:50:14 (24780): No heartbeat from core client for 30 sec - exiting 18:50:15 (24780): No heartbeat from core client for 30 sec - exiting 18:50:16 (24780): No heartbeat from core client for 30 sec - exiting 18:50:17 (24780): No heartbeat from core client for 30 sec - exiting 18:50:18 (24780): No heartbeat from core client for 30 sec - exiting 18:50:19 (24780): No heartbeat from core client for 30 sec - exiting 18:50:20 (24780): No heartbeat from core client for 30 sec - exiting 18:50:21 (24780): No heartbeat from core client for 30 sec - exiting 18:50:22 (24780): No heartbeat from core client for 30 sec - exiting 18:50:23 (24780): No heartbeat from core client for 30 sec - exiting 18:50:24 (24780): No heartbeat from core client for 30 sec - exiting 18:50:25 (24780): No heartbeat from core client for 30 sec - exiting 18:50:26 (24780): No heartbeat from core client for 30 sec - exiting 18:50:27 (24780): No heartbeat from core client for 30 sec - exiting 18:50:28 (24780): No heartbeat from core client for 30 sec - exiting 18:50:29 (24780): No heartbeat from core client for 30 sec - exiting 18:50:30 (24780): No heartbeat from core client for 30 sec - exiting 18:50:31 (24780): No heartbeat from core client for 30 sec - exiting 18:50:32 (24780): No heartbeat from core client for 30 sec - exiting 18:50:33 (24780): No heartbeat from core client for 30 sec - exiting 18:50:34 (24780): No heartbeat from core client for 30 sec - exiting 18:50:35 (24780): No heartbeat from core client for 30 sec - exiting 18:50:36 (24780): No heartbeat from core client for 30 sec - exiting 18:50:37 (24780): No heartbeat from core client for 30 sec - exiting 18:50:38 (24780): No heartbeat from core client for 30 sec - exiting 18:50:39 (24780): No heartbeat from core client for 30 sec - exiting 18:50:40 (24780): No heartbeat from core client for 30 sec - exiting 18:50:41 (24780): No heartbeat from core client for 30 sec - exiting 18:50:42 (24780): No heartbeat from core client for 30 sec - exiting 18:50:43 (24780): No heartbeat from core client for 30 sec - exiting 18:50:44 (24780): No heartbeat from core client for 30 sec - exiting 18:50:45 (24780): No heartbeat from core client for 30 sec - exiting 18:50:46 (24780): No heartbeat from core client for 30 sec - exiting 18:50:47 (24780): No heartbeat from core client for 30 sec - exiting 18:50:48 (24780): No heartbeat from core client for 30 sec - exiting 18:50:49 (24780): No heartbeat from core client for 30 sec - exiting 18:50:50 (24780): No heartbeat from core client for 30 sec - exiting 18:50:51 (24780): No heartbeat from core client for 30 sec - exiting 18:50:52 (24780): No heartbeat from core client for 30 sec - exiting 18:50:53 (24780): No heartbeat from core client for 30 sec - exiting 18:50:54 (24780): No heartbeat from core client for 30 sec - exiting 18:50:55 (24780): No heartbeat from core client for 30 sec - exiting 18:50:56 (24780): No heartbeat from core client for 30 sec - exiting 18:50:57 (24780): No heartbeat from core client for 30 sec - exiting 18:50:59 (24780): No heartbeat from core client for 30 sec - exiting 18:51:00 (24780): No heartbeat from core client for 30 sec - exiting 18:51:01 (24780): No heartbeat from core client for 30 sec - exiting 18:51:02 (24780): No heartbeat from core client for 30 sec - exiting 18:51:03 (24780): No heartbeat from core client for 30 sec - exiting 18:51:04 (24780): No heartbeat from core client for 30 sec - exiting 18:51:05 (24780): No heartbeat from core client for 30 sec - exiting 18:51:06 (24780): No heartbeat from core client for 30 sec - exiting 18:51:07 (24780): No heartbeat from core client for 30 sec - exiting 18:51:08 (24780): No heartbeat from core client for 30 sec - exiting 18:51:09 (24780): No heartbeat from core client for 30 sec - exiting 18:51:10 (24780): No heartbeat from core client for 30 sec - exiting 18:51:11 (24780): No heartbeat from core client for 30 sec - exiting 18:51:12 (24780): No heartbeat from core client for 30 sec - exiting 18:51:13 (24780): No heartbeat from core client for 30 sec - exiting 18:51:14 (24780): No heartbeat from core client for 30 sec - exiting 18:51:15 (24780): No heartbeat from core client for 30 sec - exiting 18:51:16 (24780): No heartbeat from core client for 30 sec - exiting 18:51:17 (24780): No heartbeat from core client for 30 sec - exiting 18:51:18 (24780): No heartbeat from core client for 30 sec - exiting 18:51:19 (24780): No heartbeat from core client for 30 sec - exiting 18:51:20 (24780): No heartbeat from core client for 30 sec - exiting 18:51:21 (24780): No heartbeat from core client for 30 sec - exiting 18:51:22 (24780): No heartbeat from core client for 30 sec - exiting 18:51:23 (24780): No heartbeat from core client for 30 sec - exiting 18:51:24 (24780): No heartbeat from core client for 30 sec - exiting 18:51:25 (24780): No heartbeat from core client for 30 sec - exiting 18:51:26 (24780): No heartbeat from core client for 30 sec - exiting 18:51:27 (24780): No heartbeat from core client for 30 sec - exiting 18:51:28 (24780): No heartbeat from core client for 30 sec - exiting 18:51:29 (24780): No heartbeat from core client for 30 sec - exiting 18:51:30 (24780): No heartbeat from core client for 30 sec - exiting 18:51:31 (24780): No heartbeat from core client for 30 sec - exiting 18:51:32 (24780): No heartbeat from core client for 30 sec - exiting 18:51:33 (24780): No heartbeat from core client for 30 sec - exiting 18:51:34 (24780): No heartbeat from core client for 30 sec - exiting 18:51:35 (24780): No heartbeat from core client for 30 sec - exiting 18:51:36 (24780): No heartbeat from core client for 30 sec - exiting 18:51:37 (24780): No heartbeat from core client for 30 sec - exiting 18:51:38 (24780): No heartbeat from core client for 30 sec - exiting 18:51:39 (24780): No heartbeat from core client for 30 sec - exiting 18:51:40 (24780): No heartbeat from core client for 30 sec - exiting 18:51:41 (24780): No heartbeat from core client for 30 sec - exiting 18:51:42 (24780): No heartbeat from core client for 30 sec - exiting 18:51:43 (24780): No heartbeat from core client for 30 sec - exiting 18:51:44 (24780): No heartbeat from core client for 30 sec - exiting 18:51:45 (24780): No heartbeat from core client for 30 sec - exiting 18:51:46 (24780): No heartbeat from core client for 30 sec - exiting 18:51:47 (24780): No heartbeat from core client for 30 sec - exiting 18:51:48 (24780): No heartbeat from core client for 30 sec - exiting 18:51:49 (24780): No heartbeat from core client for 30 sec - exiting 18:51:50 (24780): No heartbeat from core client for 30 sec - exiting 18:51:51 (24780): No heartbeat from core client for 30 sec - exiting 18:51:52 (24780): No heartbeat from core client for 30 sec - exiting 18:51:53 (24780): No heartbeat from core client for 30 sec - exiting 18:51:54 (24780): No heartbeat from core client for 30 sec - exiting 18:51:55 (24780): No heartbeat from core client for 30 sec - exiting 18:51:56 (24780): No heartbeat from core client for 30 sec - exiting 18:51:57 (24780): No heartbeat from core client for 30 sec - exiting 18:51:58 (24780): No heartbeat from core client for 30 sec - exiting 18:51:59 (24780): No heartbeat from core client for 30 sec - exiting 18:52:00 (24780): No heartbeat from core client for 30 sec - exiting 18:52:01 (24780): No heartbeat from core client for 30 sec - exiting 18:52:02 (24780): No heartbeat from core client for 30 sec - exiting 18:52:03 (24780): No heartbeat from core client for 30 sec - exiting 18:52:04 (24780): No heartbeat from core client for 30 sec - exiting 18:52:05 (24780): No heartbeat from core client for 30 sec - exiting 18:52:06 (24780): No heartbeat from core client for 30 sec - exiting 18:52:07 (24780): No heartbeat from core client for 30 sec - exiting 18:52:08 (24780): No heartbeat from core client for 30 sec - exiting 18:52:09 (24780): No heartbeat from core client for 30 sec - exiting 18:52:10 (24780): No heartbeat from core client for 30 sec - exiting 18:52:11 (24780): No heartbeat from core client for 30 sec - exiting 18:52:12 (24780): No heartbeat from core client for 30 sec - exiting 18:52:13 (24780): No heartbeat from core client for 30 sec - exiting 18:52:14 (24780): No heartbeat from core client for 30 sec - exiting 18:52:15 (24780): No heartbeat from core client for 30 sec - exiting 18:52:16 (24780): No heartbeat from core client for 30 sec - exiting 18:52:17 (24780): No heartbeat from core client for 30 sec - exiting 18:52:18 (24780): No heartbeat from core client for 30 sec - exiting 18:52:19 (24780): No heartbeat from core client for 30 sec - exiting 18:52:20 (24780): No heartbeat from core client for 30 sec - exiting 18:52:21 (24780): No heartbeat from core client for 30 sec - exiting 18:52:22 (24780): No heartbeat from core client for 30 sec - exiting 18:52:23 (24780): No heartbeat from core client for 30 sec - exiting 18:52:24 (24780): No heartbeat from core client for 30 sec - exiting 18:52:25 (24780): No heartbeat from core client for 30 sec - exiting 18:52:26 (24780): No heartbeat from core client for 30 sec - exiting 18:52:27 (24780): No heartbeat from core client for 30 sec - exiting 18:52:28 (24780): No heartbeat from core client for 30 sec - exiting 18:52:29 (24780): No heartbeat from core client for 30 sec - exiting 18:52:30 (24780): No heartbeat from core client for 30 sec - exiting 18:52:31 (24780): No heartbeat from core client for 30 sec - exiting 18:52:32 (24780): No heartbeat from core client for 30 sec - exiting 18:52:33 (24780): No heartbeat from core client for 30 sec - exiting 18:52:34 (24780): No heartbeat from core client for 30 sec - exiting 18:52:35 (24780): No heartbeat from core client for 30 sec - exiting 18:52:36 (24780): No heartbeat from core client for 30 sec - exiting 18:52:37 (24780): No heartbeat from core client for 30 sec - exiting 18:52:38 (24780): No heartbeat from core client for 30 sec - exiting 18:52:39 (24780): No heartbeat from core client for 30 sec - exiting 18:52:40 (24780): No heartbeat from core client for 30 sec - exiting 18:52:41 (24780): No heartbeat from core client for 30 sec - exiting 18:52:42 (24780): No heartbeat from core client for 30 sec - exiting 18:52:43 (24780): No heartbeat from core client for 30 sec - exiting 18:52:44 (24780): No heartbeat from core client for 30 sec - exiting 18:52:45 (24780): No heartbeat from core client for 30 sec - exiting 18:52:46 (24780): No heartbeat from core client for 30 sec - exiting 18:52:47 (24780): No heartbeat from core client for 30 sec - exiting 18:52:48 (24780): No heartbeat from core client for 30 sec - exiting 18:52:49 (24780): No heartbeat from core client for 30 sec - exiting 18:52:50 (24780): No heartbeat from core client for 30 sec - exiting 18:52:51 (24780): No heartbeat from core client for 30 sec - exiting 18:52:52 (24780): No heartbeat from core client for 30 sec - exiting 18:52:53 (24780): No heartbeat from core client for 30 sec - exiting 18:52:54 (24780): No heartbeat from core client for 30 sec - exiting 18:52:55 (24780): No heartbeat from core client for 30 sec - exiting 18:52:56 (24780): No heartbeat from core client for 30 sec - exiting 18:52:57 (24780): No heartbeat from core client for 30 sec - exiting 18:52:58 (24780): No heartbeat from core client for 30 sec - exiting 18:52:59 (24780): No heartbeat from core client for 30 sec - exiting 18:53:00 (24780): No heartbeat from core client for 30 sec - exiting 18:53:01 (24780): No heartbeat from core client for 30 sec - exiting 18:53:02 (24780): No heartbeat from core client for 30 sec - exiting 18:53:03 (24780): No heartbeat from core client for 30 sec - exiting 18:53:04 (24780): No heartbeat from core client for 30 sec - exiting 18:53:05 (24780): No heartbeat from core client for 30 sec - exiting 18:53:06 (24780): No heartbeat from core client for 30 sec - exiting 18:53:07 (24780): No heartbeat from core client for 30 sec - exiting 18:53:08 (24780): No heartbeat from core client for 30 sec - exiting 18:53:09 (24780): No heartbeat from core client for 30 sec - exiting 18:53:10 (24780): No heartbeat from core client for 30 sec - exiting 18:53:11 (24780): No heartbeat from core client for 30 sec - exiting 18:53:12 (24780): No heartbeat from core client for 30 sec - exiting 18:53:13 (24780): No heartbeat from core client for 30 sec - exiting 18:53:14 (24780): No heartbeat from core client for 30 sec - exiting 18:53:15 (24780): No heartbeat from core client for 30 sec - exiting 18:53:16 (24780): No heartbeat from core client for 30 sec - exiting 18:53:17 (24780): No heartbeat from core client for 30 sec - exiting 18:53:18 (24780): No heartbeat from core client for 30 sec - exiting 18:53:19 (24780): No heartbeat from core client for 30 sec - exiting 18:53:20 (24780): No heartbeat from core client for 30 sec - exiting 18:53:21 (24780): No heartbeat from core client for 30 sec - exiting 18:53:22 (24780): No heartbeat from core client for 30 sec - exiting 18:53:23 (24780): No heartbeat from core client for 30 sec - exiting 18:53:24 (24780): No heartbeat from core client for 30 sec - exiting 18:53:25 (24780): No heartbeat from core client for 30 sec - exiting 18:53:26 (24780): No heartbeat from core client for 30 sec - exiting 18:53:27 (24780): No heartbeat from core client for 30 sec - exiting 18:53:28 (24780): No heartbeat from core client for 30 sec - exiting 18:53:29 (24780): No heartbeat from core client for 30 sec - exiting 18:53:30 (24780): No heartbeat from core client for 30 sec - exiting 18:53:31 (24780): No heartbeat from core client for 30 sec - exiting 18:53:32 (24780): No heartbeat from core client for 30 sec - exiting 18:53:33 (24780): No heartbeat from core client for 30 sec - exiting 18:53:34 (24780): No heartbeat from core client for 30 sec - exiting 18:53:35 (24780): No heartbeat from core client for 30 sec - exiting 18:53:36 (24780): No heartbeat from core client for 30 sec - exiting 18:53:37 (24780): No heartbeat from core client for 30 sec - exiting 18:53:38 (24780): No heartbeat from core client for 30 sec - exiting 18:53:39 (24780): No heartbeat from core client for 30 sec - exiting 18:53:40 (24780): No heartbeat from core client for 30 sec - exiting 18:53:41 (24780): No heartbeat from core client for 30 sec - exiting 18:53:42 (24780): No heartbeat from core client for 30 sec - exiting 18:53:43 (24780): No heartbeat from core client for 30 sec - exiting 18:53:44 (24780): No heartbeat from core client for 30 sec - exiting 18:53:45 (24780): No heartbeat from core client for 30 sec - exiting 18:53:46 (24780): No heartbeat from core client for 30 sec - exiting 18:53:47 (24780): No heartbeat from core client for 30 sec - exiting 18:53:48 (24780): No heartbeat from core client for 30 sec - exiting 18:53:49 (24780): No heartbeat from core client for 30 sec - exiting 18:53:50 (24780): No heartbeat from core client for 30 sec - exiting 18:53:51 (24780): No heartbeat from core client for 30 sec - exiting 18:53:52 (24780): No heartbeat from core client for 30 sec - exiting 18:53:53 (24780): No heartbeat from core client for 30 sec - exiting 18:53:54 (24780): No heartbeat from core client for 30 sec - exiting 18:53:55 (24780): No heartbeat from core client for 30 sec - exiting 18:53:56 (24780): No heartbeat from core client for 30 sec - exiting 18:53:57 (24780): No heartbeat from core client for 30 sec - exiting 18:53:58 (24780): No heartbeat from core client for 30 sec - exiting 18:53:59 (24780): No heartbeat from core client for 30 sec - exiting 18:54:00 (24780): No heartbeat from core client for 30 sec - exiting 18:54:01 (24780): No heartbeat from core client for 30 sec - exiting 18:54:02 (24780): No heartbeat from core client for 30 sec - exiting 18:54:03 (24780): No heartbeat from core client for 30 sec - exiting 18:54:04 (24780): No heartbeat from core client for 30 sec - exiting 18:54:05 (24780): No heartbeat from core client for 30 sec - exiting 18:54:06 (24780): No heartbeat from core client for 30 sec - exiting 18:54:07 (24780): No heartbeat from core client for 30 sec - exiting 18:54:08 (24780): No heartbeat from core client for 30 sec - exiting 18:54:09 (24780): No heartbeat from core client for 30 sec - exiting 18:54:10 (24780): No heartbeat from core client for 30 sec - exiting 18:54:11 (24780): No heartbeat from core client for 30 sec - exiting 18:54:12 (24780): No heartbeat from core client for 30 sec - exiting 18:54:13 (24780): No heartbeat from core client for 30 sec - exiting 18:54:14 (24780): No heartbeat from core client for 30 sec - exiting 18:54:15 (24780): No heartbeat from core client for 30 sec - exiting 18:54:16 (24780): No heartbeat from core client for 30 sec - exiting 18:54:17 (24780): No heartbeat from core client for 30 sec - exiting 18:54:18 (24780): No heartbeat from core client for 30 sec - exiting 18:54:19 (24780): No heartbeat from core client for 30 sec - exiting 18:54:20 (24780): No heartbeat from core client for 30 sec - exiting 18:54:21 (24780): No heartbeat from core client for 30 sec - exiting 18:54:22 (24780): No heartbeat from core client for 30 sec - exiting 18:54:23 (24780): No heartbeat from core client for 30 sec - exiting 18:54:24 (24780): No heartbeat from core client for 30 sec - exiting 18:54:25 (24780): No heartbeat from core client for 30 sec - exiting 18:54:26 (24780): No heartbeat from core client for 30 sec - exiting 18:54:27 (24780): No heartbeat from core client for 30 sec - exiting 18:54:28 (24780): No heartbeat from core client for 30 sec - exiting 18:54:29 (24780): No heartbeat from core client for 30 sec - exiting 18:54:30 (24780): No heartbeat from core client for 30 sec - exiting 18:54:31 (24780): No heartbeat from core client for 30 sec - exiting 18:54:32 (24780): No heartbeat from core client for 30 sec - exiting 18:54:33 (24780): No heartbeat from core client for 30 sec - exiting 18:54:34 (24780): No heartbeat from core client for 30 sec - exiting 18:54:35 (24780): No heartbeat from core client for 30 sec - exiting 18:54:36 (24780): No heartbeat from core client for 30 sec - exiting 18:54:37 (24780): No heartbeat from core client for 30 sec - exiting 18:54:38 (24780): No heartbeat from core client for 30 sec - exiting 18:54:39 (24780): No heartbeat from core client for 30 sec - exiting 18:54:40 (24780): No heartbeat from core client for 30 sec - exiting 18:54:41 (24780): No heartbeat from core client for 30 sec - exiting 18:54:42 (24780): No heartbeat from core client for 30 sec - exiting 18:54:43 (24780): No heartbeat from core client for 30 sec - exiting 18:54:44 (24780): No heartbeat from core client for 30 sec - exiting 18:54:45 (24780): No heartbeat from core client for 30 sec - exiting 18:54:46 (24780): No heartbeat from core client for 30 sec - exiting 18:54:47 (24780): No heartbeat from core client for 30 sec - exiting 18:54:48 (24780): No heartbeat from core client for 30 sec - exiting 18:54:49 (24780): No heartbeat from core client for 30 sec - exiting 18:54:50 (24780): No heartbeat from core client for 30 sec - exiting 18:54:51 (24780): No heartbeat from core client for 30 sec - exiting 18:54:52 (24780): No heartbeat from core client for 30 sec - exiting 18:54:53 (24780): No heartbeat from core client for 30 sec - exiting 18:54:54 (24780): No heartbeat from core client for 30 sec - exiting 18:54:55 (24780): No heartbeat from core client for 30 sec - exiting 18:54:56 (24780): No heartbeat from core client for 30 sec - exiting 18:54:57 (24780): No heartbeat from core client for 30 sec - exiting 18:54:58 (24780): No heartbeat from core client for 30 sec - exiting 18:54:59 (24780): No heartbeat from core client for 30 sec - exiting 18:55:00 (24780): No heartbeat from core client for 30 sec - exiting 18:55:01 (24780): No heartbeat from core client for 30 sec - exiting 18:55:02 (24780): No heartbeat from core client for 30 sec - exiting 18:55:03 (24780): No heartbeat from core client for 30 sec - exiting 18:55:04 (24780): No heartbeat from core client for 30 sec - exiting 18:55:05 (24780): No heartbeat from core client for 30 sec - exiting 18:55:06 (24780): No heartbeat from core client for 30 sec - exiting 18:55:07 (24780): No heartbeat from core client for 30 sec - exiting 18:55:08 (24780): No heartbeat from core client for 30 sec - exiting 18:55:09 (24780): No heartbeat from core client for 30 sec - exiting 18:55:10 (24780): No heartbeat from core client for 30 sec - exiting 18:55:11 (24780): No heartbeat from core client for 30 sec - exiting 18:55:12 (24780): No heartbeat from core client for 30 sec - exiting 18:55:13 (24780): No heartbeat from core client for 30 sec - exiting 18:55:14 (24780): No heartbeat from core client for 30 sec - exiting 18:55:15 (24780): No heartbeat from core client for 30 sec - exiting 18:55:16 (24780): No heartbeat from core client for 30 sec - exiting 18:55:17 (24780): No heartbeat from core client for 30 sec - exiting 18:55:18 (24780): No heartbeat from core client for 30 sec - exiting 18:55:19 (24780): No heartbeat from core client for 30 sec - exiting 18:55:20 (24780): No heartbeat from core client for 30 sec - exiting 18:55:21 (24780): No heartbeat from core client for 30 sec - exiting 18:55:22 (24780): No heartbeat from core client for 30 sec - exiting 18:55:23 (24780): No heartbeat from core client for 30 sec - exiting 18:55:24 (24780): No heartbeat from core client for 30 sec - exiting 18:55:25 (24780): No heartbeat from core client for 30 sec - exiting 18:55:26 (24780): No heartbeat from core client for 30 sec - exiting 18:55:27 (24780): No heartbeat from core client for 30 sec - exiting 18:55:28 (24780): No heartbeat from core client for 30 sec - exiting 18:55:29 (24780): No heartbeat from core client for 30 sec - exiting 18:55:30 (24780): No heartbeat from core client for 30 sec - exiting 18:55:31 (24780): No heartbeat from core client for 30 sec - exiting 18:55:32 (24780): No heartbeat from core client for 30 sec - exiting 18:55:33 (24780): No heartbeat from core client for 30 sec - exiting 18:55:34 (24780): No heartbeat from core client for 30 sec - exiting 18:55:35 (24780): No heartbeat from core client for 30 sec - exiting 18:55:36 (24780): No heartbeat from core client for 30 sec - exiting 18:55:37 (24780): No heartbeat from core client for 30 sec - exiting 18:55:38 (24780): No heartbeat from core client for 30 sec - exiting 18:55:39 (24780): No heartbeat from core client for 30 sec - exiting 18:55:40 (24780): No heartbeat from core client for 30 sec - exiting 18:55:41 (24780): No heartbeat from core client for 30 sec - exiting 18:55:42 (24780): No heartbeat from core client for 30 sec - exiting 18:55:43 (24780): No heartbeat from core client for 30 sec - exiting 18:55:44 (24780): No heartbeat from core client for 30 sec - exiting 18:55:45 (24780): No heartbeat from core client for 30 sec - exiting 18:55:46 (24780): No heartbeat from core client for 30 sec - exiting 18:55:47 (24780): No heartbeat from core client for 30 sec - exiting 18:55:48 (24780): No heartbeat from core client for 30 sec - exiting 18:55:49 (24780): No heartbeat from core client for 30 sec - exiting 18:55:50 (24780): No heartbeat from core client for 30 sec - exiting 18:55:51 (24780): No heartbeat from core client for 30 sec - exiting 18:55:52 (24780): No heartbeat from core client for 30 sec - exiting 18:55:53 (24780): No heartbeat from core client for 30 sec - exiting 18:55:54 (24780): No heartbeat from core client for 30 sec - exiting 18:55:55 (24780): No heartbeat from core client for 30 sec - exiting 18:55:56 (24780): No heartbeat from core client for 30 sec - exiting 18:55:57 (24780): No heartbeat from core client for 30 sec - exiting 18:55:58 (24780): No heartbeat from core client for 30 sec - exiting 18:55:59 (24780): No heartbeat from core client for 30 sec - exiting 18:56:00 (24780): No heartbeat from core client for 30 sec - exiting 18:56:01 (24780): No heartbeat from core client for 30 sec - exiting 18:56:02 (24780): No heartbeat from core client for 30 sec - exiting 18:56:03 (24780): No heartbeat from core client for 30 sec - exiting 18:56:04 (24780): No heartbeat from core client for 30 sec - exiting 18:56:05 (24780): No heartbeat from core client for 30 sec - exiting 18:56:06 (24780): No heartbeat from core client for 30 sec - exiting 18:56:07 (24780): No heartbeat from core client for 30 sec - exiting 18:56:08 (24780): No heartbeat from core client for 30 sec - exiting 18:56:09 (24780): No heartbeat from core client for 30 sec - exiting 18:56:10 (24780): No heartbeat from core client for 30 sec - exiting 18:56:11 (24780): No heartbeat from core client for 30 sec - exiting 18:56:12 (24780): No heartbeat from core client for 30 sec - exiting 18:56:13 (24780): No heartbeat from core client for 30 sec - exiting 18:56:14 (24780): No heartbeat from core client for 30 sec - exiting 18:56:15 (24780): No heartbeat from core client for 30 sec - exiting 18:56:16 (24780): No heartbeat from core client for 30 sec - exiting 18:56:17 (24780): No heartbeat from core client for 30 sec - exiting 18:56:18 (24780): No heartbeat from core client for 30 sec - exiting 18:56:19 (24780): No heartbeat from core client for 30 sec - exiting 18:56:20 (24780): No heartbeat from core client for 30 sec - exiting 18:56:21 (24780): No heartbeat from core client for 30 sec - exiting 18:56:22 (24780): No heartbeat from core client for 30 sec - exiting 18:56:23 (24780): No heartbeat from core client for 30 sec - exiting 18:56:24 (24780): No heartbeat from core client for 30 sec - exiting 18:56:25 (24780): No heartbeat from core client for 30 sec - exiting 18:56:26 (24780): No heartbeat from core client for 30 sec - exiting 18:56:27 (24780): No heartbeat from core client for 30 sec - exiting 18:56:28 (24780): No heartbeat from core client for 30 sec - exiting 18:56:29 (24780): No heartbeat from core client for 30 sec - exiting 18:56:30 (24780): No heartbeat from core client for 30 sec - exiting 18:56:31 (24780): No heartbeat from core client for 30 sec - exiting 18:56:32 (24780): No heartbeat from core client for 30 sec - exiting 18:56:33 (24780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:10:39 (17252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:40 (17252): No heartbeat from core client for 30 sec - exiting 19:10:41 (17252): No heartbeat from core client for 30 sec - exiting 19:15:18 (16884): No heartbeat from core client for 30 sec - exiting 19:15:19 (16884): No heartbeat from core client for 30 sec - exiting 19:15:20 (16884): No heartbeat from core client for 30 sec - exiting 19:15:21 (16884): No heartbeat from core client for 30 sec - exiting 19:15:22 (16884): No heartbeat from core client for 30 sec - exiting 19:15:23 (16884): No heartbeat from core client for 30 sec - exiting 19:15:24 (16884): No heartbeat from core client for 30 sec - exiting 19:15:25 (16884): No heartbeat from core client for 30 sec - exiting 19:15:26 (16884): No heartbeat from core client for 30 sec - exiting 19:15:27 (16884): No heartbeat from core client for 30 sec - exiting 19:15:28 (16884): No heartbeat from core client for 30 sec - exiting 19:15:29 (16884): No heartbeat from core client for 30 sec - exiting 19:15:30 (16884): No heartbeat from core client for 30 sec - exiting 19:15:31 (16884): No heartbeat from core client for 30 sec - exiting 19:15:32 (16884): No heartbeat from core client for 30 sec - exiting 19:15:33 (16884): No heartbeat from core client for 30 sec - exiting 19:15:34 (16884): No heartbeat from core client for 30 sec - exiting 19:15:35 (16884): No heartbeat from core client for 30 sec - exiting 19:15:36 (16884): No heartbeat from core client for 30 sec - exiting 19:15:37 (16884): No heartbeat from core client for 30 sec - exiting 19:15:38 (16884): No heartbeat from core client for 30 sec - exiting 19:15:39 (16884): No heartbeat from core client for 30 sec - exiting 19:15:40 (16884): No heartbeat from core client for 30 sec - exiting 19:15:41 (16884): No heartbeat from core client for 30 sec - exiting 19:15:42 (16884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:36 (18260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9648, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9648, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9648, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14240, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 20:10:09	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	518,400	680,023	1.3118
23 Jul 2013 19:55:23	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	492,480	650,637	1.3211
23 Jul 2013 19:29:26	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	466,560	620,266	1.3294
23 Jul 2013 19:00:42	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	440,640	591,267	1.3418
23 Jul 2013 14:32:57	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	414,720	552,539	1.3323
23 Jul 2013 14:32:57	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	388,800	522,990	1.3451
23 Jul 2013 14:32:57	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	362,880	484,608	1.3354
23 Jul 2013 14:32:57	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	336,960	446,756	1.3258
07 Jul 2013 07:50:50	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	311,040	413,431	1.3292
06 Jul 2013 12:01:56	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	285,120	380,643	1.3350
06 Jul 2013 05:39:06	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	259,200	344,714	1.3299
06 Jul 2013 05:17:22	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	233,280	315,485	1.3524
06 Jul 2013 04:36:49	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	207,360	285,546	1.3771
26 Jun 2013 01:10:16	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	181,440	250,226	1.3791
25 Jun 2013 16:05:49	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	155,520	217,831	1.4007
25 Jun 2013 03:03:40	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	129,600	187,003	1.4429
24 Jun 2013 20:08:12	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	103,680	162,345	1.5658
24 Jun 2013 12:16:27	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	77,760	137,717	1.7711
22 Jun 2013 22:47:19	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	51,840	95,265	1.8377
22 Jun 2013 04:18:42	1224915	15845022	hadcm3n_4hf4_1980_40_008390334_2	25,920	48,146	1.8575