Task 16048121

Name	hadcm3n_of5z_1900_40_008474778_1
Workunit	8625617
Created	28 Sep 2013, 11:07:19 UTC
Sent	28 Sep 2013, 11:27:38 UTC
Report deadline	28 Dec 2013, 18:54:49 UTC
Received	29 Oct 2013, 22:29:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1294904
Run time	27 days 7 hours 46 min 7 sec
CPU time	22 days 7 hours 22 min 3 sec
Validate state	Invalid
Credit	10,264.32
Device peak FLOPS	2.13 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.23</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 14:31:02 (27220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:31:03 (27220): No heartbeat from core client for 30 sec - exiting 14:31:04 (27220): No heartbeat from core client for 30 sec - exiting 14:31:05 (27220): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:06:34 (17240): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 05:07:17 (17240): No heartbeat from core client for 30 sec - exiting 05:08:20 (17240): No heartbeat from core client for 30 sec - exiting 05:08:51 (17240): No heartbeat from core client for 30 sec - exiting 05:09:06 (17240): No heartbeat from core client for 30 sec - exiting 05:09:13 (17240): No heartbeat from core client for 30 sec - exiting 05:09:14 (17240): No heartbeat from core client for 30 sec - exiting 05:09:15 (17240): No heartbeat from core client for 30 sec - exiting 05:09:16 (17240): No heartbeat from core client for 30 sec - exiting 05:09:17 (17240): No heartbeat from core client for 30 sec - exiting 05:09:19 (17240): No heartbeat from core client for 30 sec - exiting 05:09:20 (17240): No heartbeat from core client for 30 sec - exiting 05:09:21 (17240): No heartbeat from core client for 30 sec - exiting 05:09:24 (17240): No heartbeat from core client for 30 sec - exiting 05:09:25 (17240): No heartbeat from core client for 30 sec - exiting 05:09:26 (17240): No heartbeat from core client for 30 sec - exiting 05:09:27 (17240): No heartbeat from core client for 30 sec - exiting 05:09:28 (17240): No heartbeat from core client for 30 sec - exiting 05:09:29 (17240): No heartbeat from core client for 30 sec - exiting 05:09:31 (17240): No heartbeat from core client for 30 sec - exiting 05:09:32 (17240): No heartbeat from core client for 30 sec - exiting 05:09:34 (17240): No heartbeat from core client for 30 sec - exiting 05:09:35 (17240): No heartbeat from core client for 30 sec - exiting 05:09:36 (17240): No heartbeat from core client for 30 sec - exiting 05:09:37 (17240): No heartbeat from core client for 30 sec - exiting 05:09:38 (17240): No heartbeat from core client for 30 sec - exiting 05:09:39 (17240): No heartbeat from core client for 30 sec - exiting 05:09:43 (17240): No heartbeat from core client for 30 sec - exiting 05:09:44 (17240): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:18:34 (11356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:18:45 (11356): No heartbeat from core client for 30 sec - exiting 16:18:46 (11356): No heartbeat from core client for 30 sec - exiting 16:18:47 (11356): No heartbeat from core client for 30 sec - exiting 16:18:49 (11356): No heartbeat from core client for 30 sec - exiting 16:18:50 (11356): No heartbeat from core client for 30 sec - exiting 16:18:51 (11356): No heartbeat from core client for 30 sec - exiting 16:18:52 (11356): No heartbeat from core client for 30 sec - exiting 16:18:54 (11356): No heartbeat from core client for 30 sec - exiting 16:18:55 (11356): No heartbeat from core client for 30 sec - exiting 16:18:56 (11356): No heartbeat from core client for 30 sec - exiting 16:18:57 (11356): No heartbeat from core client for 30 sec - exiting 16:18:59 (11356): No heartbeat from core client for 30 sec - exiting 16:19:00 (11356): No heartbeat from core client for 30 sec - exiting 16:19:01 (11356): No heartbeat from core client for 30 sec - exiting 16:19:02 (11356): No heartbeat from core client for 30 sec - exiting 16:19:03 (11356): No heartbeat from core client for 30 sec - exiting 16:19:04 (11356): No heartbeat from core client for 30 sec - exiting 16:19:05 (11356): No heartbeat from core client for 30 sec - exiting 16:19:07 (11356): No heartbeat from core client for 30 sec - exiting 16:19:08 (11356): No heartbeat from core client for 30 sec - exiting 16:19:09 (11356): No heartbeat from core client for 30 sec - exiting 16:19:10 (11356): No heartbeat from core client for 30 sec - exiting 16:19:11 (11356): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:58:22 (5760): No heartbeat from core client for 30 sec - exiting 17:58:23 (5760): No heartbeat from core client for 30 sec - exiting 17:58:24 (5760): No heartbeat from core client for 30 sec - exiting 17:58:25 (5760): No heartbeat from core client for 30 sec - exiting 17:58:26 (5760): No heartbeat from core client for 30 sec - exiting 17:58:27 (5760): No heartbeat from core client for 30 sec - exiting 17:58:28 (5760): No heartbeat from core client for 30 sec - exiting 17:58:29 (5760): No heartbeat from core client for 30 sec - exiting 17:58:30 (5760): No heartbeat from core client for 30 sec - exiting 17:58:31 (5760): No heartbeat from core client for 30 sec - exiting 17:58:32 (5760): No heartbeat from core client for 30 sec - exiting 17:58:33 (5760): No heartbeat from core client for 30 sec - exiting 17:58:34 (5760): No heartbeat from core client for 30 sec - exiting 17:58:35 (5760): No heartbeat from core client for 30 sec - exiting 17:58:36 (5760): No heartbeat from core client for 30 sec - exiting 17:58:37 (5760): No heartbeat from core client for 30 sec - exiting 17:58:38 (5760): No heartbeat from core client for 30 sec - exiting 17:58:39 (5760): No heartbeat from core client for 30 sec - exiting 17:58:40 (5760): No heartbeat from core client for 30 sec - exiting 17:58:41 (5760): No heartbeat from core client for 30 sec - exiting 17:58:42 (5760): No heartbeat from core client for 30 sec - exiting 17:58:44 (5760): No heartbeat from core client for 30 sec - exiting 17:58:45 (5760): No heartbeat from core client for 30 sec - exiting 17:58:46 (5760): No heartbeat from core client for 30 sec - exiting 17:58:47 (5760): No heartbeat from core client for 30 sec - exiting 17:58:48 (5760): No heartbeat from core client for 30 sec - exiting 17:58:49 (5760): No heartbeat from core client for 30 sec - exiting 17:58:50 (5760): No heartbeat from core client for 30 sec - exiting 17:58:51 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:24:08 (6196): No heartbeat from core client for 30 sec - exiting 03:24:09 (6196): No heartbeat from core client for 30 sec - exiting 03:24:11 (6196): No heartbeat from core client for 30 sec - exiting 03:24:12 (6196): No heartbeat from core client for 30 sec - exiting 03:24:13 (6196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:06:25 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:50:43 (3572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:27:39 (6488): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 05:27:41 (6488): No heartbeat from core client for 30 sec - exiting 05:27:42 (6488): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:16:09 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:16:11 (5976): No heartbeat from core client for 30 sec - exiting 02:16:12 (5976): No heartbeat from core client for 30 sec - exiting 02:16:13 (5976): No heartbeat from core client for 30 sec - exiting 02:16:14 (5976): No heartbeat from core client for 30 sec - exiting 02:16:15 (5976): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:13:53 (6416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:13:55 (6416): No heartbeat from core client for 30 sec - exiting 08:13:56 (6416): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:07:04 (9160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:07:05 (9160): No heartbeat from core client for 30 sec - exiting 11:08:26 (8616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:06:09 (8516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:24:19 (8800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:24:20 (8800): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:24:23 (5916): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 21:24:27 (5916): No heartbeat from core client for 30 sec - exiting 21:24:28 (5916): No heartbeat from core client for 30 sec - exiting 21:24:29 (5916): No heartbeat from core client for 30 sec - exiting 21:24:30 (5916): No heartbeat from core client for 30 sec - exiting 21:24:31 (5916): No heartbeat from core client for 30 sec - exiting 21:24:32 (5916): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:41:28 (4832): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:41:31 (4832): No heartbeat from core client for 30 sec - exiting 02:41:32 (4832): No heartbeat from core client for 30 sec - exiting 02:41:33 (4832): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:00:52 (7500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:04 (7500): No heartbeat from core client for 30 sec - exiting 00:01:05 (7500): No heartbeat from core client for 30 sec - exiting 00:01:06 (7500): No heartbeat from core client for 30 sec - exiting 00:01:07 (7500): No heartbeat from core client for 30 sec - exiting 00:01:08 (7500): No heartbeat from core client for 30 sec - exiting 00:01:09 (7500): No heartbeat from core client for 30 sec - exiting 00:01:10 (7500): No heartbeat from core client for 30 sec - exiting 00:01:11 (7500): No heartbeat from core client for 30 sec - exiting 00:01:13 (7500): No heartbeat from core client for 30 sec - exiting 00:01:14 (7500): No heartbeat from core client for 30 sec - exiting 00:01:15 (7500): No heartbeat from core client for 30 sec - exiting 00:01:16 (7500): No heartbeat from core client for 30 sec - exiting 00:01:17 (7500): No heartbeat from core client for 30 sec - exiting 00:01:18 (7500): No heartbeat from core client for 30 sec - exiting 00:01:19 (7500): No heartbeat from core client for 30 sec - exiting 00:01:20 (7500): No heartbeat from core client for 30 sec - exiting 00:01:21 (7500): No heartbeat from core client for 30 sec - exiting 00:01:22 (7500): No heartbeat from core client for 30 sec - exiting 00:01:24 (7500): No heartbeat from core client for 30 sec - exiting 00:01:26 (7500): No heartbeat from core client for 30 sec - exiting 00:01:27 (7500): No heartbeat from core client for 30 sec - exiting 00:01:28 (7500): No heartbeat from core client for 30 sec - exiting 00:01:29 (7500): No heartbeat from core client for 30 sec - exiting 00:01:30 (7500): No heartbeat from core client for 30 sec - exiting 00:01:31 (7500): No heartbeat from core client for 30 sec - exiting 00:01:32 (7500): No heartbeat from core client for 30 sec - exiting 00:01:34 (7500): No heartbeat from core client for 30 sec - exiting 00:01:35 (7500): No heartbeat from core client for 30 sec - exiting 00:01:36 (7500): No heartbeat from core client for 30 sec - exiting 00:01:37 (7500): No heartbeat from core client for 30 sec - exiting 00:01:38 (7500): No heartbeat from core client for 30 sec - exiting 00:01:39 (7500): No heartbeat from core client for 30 sec - exiting 00:06:35 (4296): No heartbeat from core client for 30 sec - exiting 00:06:36 (4296): No heartbeat from core client for 30 sec - exiting 00:06:37 (4296): No heartbeat from core client for 30 sec - exiting 00:06:38 (4296): No heartbeat from core client for 30 sec - exiting 00:06:39 (4296): No heartbeat from core client for 30 sec - exiting 00:06:41 (4296): No heartbeat from core client for 30 sec - exiting 00:06:42 (4296): No heartbeat from core client for 30 sec - exiting 00:06:43 (4296): No heartbeat from core client for 30 sec - exiting 00:06:44 (4296): No heartbeat from core client for 30 sec - exiting 00:06:45 (4296): No heartbeat from core client for 30 sec - exiting 00:06:46 (4296): No heartbeat from core client for 30 sec - exiting 00:06:47 (4296): No heartbeat from core client for 30 sec - exiting 00:06:48 (4296): No heartbeat from core client for 30 sec - exiting 00:06:49 (4296): No heartbeat from core client for 30 sec - exiting 00:06:50 (4296): No heartbeat from core client for 30 sec - exiting 00:06:51 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:41:13 (7140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:41:14 (7140): No heartbeat from core client for 30 sec - exiting 06:41:15 (7140): No heartbeat from core client for 30 sec - exiting 06:42:29 (6436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8024, iMonCtr=1 Model crash detected, will try to restar15:27:31 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:44:45 (6972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4204, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4204, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4204, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4204, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4204, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Oct 2013 00:01:27	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	855,360	1,911,224	2.2344
27 Oct 2013 03:36:26	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	829,440	1,848,123	2.2282
26 Oct 2013 09:02:15	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	803,520	1,787,665	2.2248
25 Oct 2013 13:54:58	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	777,600	1,724,831	2.2181
24 Oct 2013 14:55:32	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	751,680	1,662,821	2.2121
23 Oct 2013 19:00:33	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	725,760	1,599,876	2.2044
22 Oct 2013 20:31:05	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	699,840	1,539,491	2.1998
21 Oct 2013 15:28:35	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	673,920	1,482,474	2.1998
20 Oct 2013 15:40:27	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	648,000	1,431,631	2.2093
19 Oct 2013 18:43:16	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	622,080	1,379,617	2.2177
19 Oct 2013 00:32:18	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	596,160	1,323,402	2.2199
17 Oct 2013 23:31:11	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	570,240	1,268,626	2.2247
17 Oct 2013 05:51:47	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	544,320	1,215,313	2.2327
16 Oct 2013 05:48:43	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	518,400	1,160,616	2.2388
15 Oct 2013 02:02:18	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	492,480	1,106,517	2.2468
14 Oct 2013 05:25:31	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	466,560	1,050,168	2.2509
13 Oct 2013 01:41:29	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	440,640	993,392	2.2544
12 Oct 2013 00:30:50	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	414,720	934,521	2.2534
11 Oct 2013 04:27:47	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	388,800	874,700	2.2497
10 Oct 2013 03:28:14	1294904	16048121	hadcm3n_of5z_1900_40_008474778_1	362,880	816,829	2.2510