Task 15422149

Name	hadcm3n_ye9j_1980_40_008243580_0
Workunit	8398704
Created	30 Oct 2012, 22:43:54 UTC
Sent	30 Oct 2012, 22:43:57 UTC
Report deadline	30 Jan 2013, 6:11:08 UTC
Received	19 Dec 2012, 0:07:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1133174
Run time	5 days 9 hours 16 min 12 sec
CPU time	5 days 8 hours 57 min 39 sec
Validate state	Invalid
Credit	4,354.56
Device peak FLOPS	3.05 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:05:46 (3304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:58:05 (4780): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:58:06 (4780): No heartbeat from core client for 30 sec - exiting 08:58:07 (4780): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:10:14 (4548): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:10:18 (4548): No heartbeat from core client for 30 sec - exiting 06:10:19 (4548): No heartbeat from core client for 30 sec - exiting 06:10:20 (4548): No heartbeat from core client for 30 sec - exiting 06:10:21 (4548): No heartbeat from core client for 30 sec - exiting 06:10:22 (4548): No heartbeat from core client for 30 sec - exiting 06:10:23 (4548): No heartbeat from core client for 30 sec - exiting 06:10:24 (4548): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:25:01 (3132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:25:02 (3132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:03:20 (2424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:32 (2424): No heartbeat from core client for 30 sec - exiting 22:03:34 (2424): No heartbeat from core client for 30 sec - exiting 22:03:35 (2424): No heartbeat from core client for 30 sec - exiting 22:03:36 (2424): No heartbeat from core client for 30 sec - exiting 22:03:37 (2424): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:19:24 (1392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:19:28 (1392): No heartbeat from core client for 30 sec - exiting 22:19:29 (1392): No heartbeat from core client for 30 sec - exiting 22:19:30 (1392): No heartbeat from core client for 30 sec - exiting 22:19:31 (1392): No heartbeat from core client for 30 sec - exiting 22:19:32 (1392): No heartbeat from core client for 30 sec - exiting 22:19:33 (1392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:16:57 (2460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:59 (2460): No heartbeat from core client for 30 sec - exiting 17:17:00 (2460): No heartbeat from core client for 30 sec - exiting 17:17:01 (2460): No heartbeat from core client for 30 sec - exiting 17:17:02 (2460): No heartbeat from core client for 30 sec - exiting 17:17:03 (2460): No heartbeat from core client for 30 sec - exiting 17:17:04 (2460): No heartbeat from core client for 30 sec - exiting 17:17:05 (2460): No heartbeat from core client for 30 sec - exiting 17:17:06 (2460): No heartbeat from core client for 30 sec - exiting 17:17:08 (2460): No heartbeat from core client for 30 sec - exiting 17:17:09 (2460): No heartbeat from core client for 30 sec - exiting 17:17:10 (2460): No heartbeat from core client for 30 sec - exiting 17:17:11 (2460): No heartbeat from core client for 30 sec - exiting 17:17:12 (2460): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:50:36 (4880): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:50:37 (4880): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:49:08 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:18 (2908): No heartbeat from core client for 30 sec - exiting 21:49:19 (2908): No heartbeat from core client for 30 sec - exiting 21:49:20 (2908): No heartbeat from core client for 30 sec - exiting 21:49:22 (2908): No heartbeat from core client for 30 sec - exiting 21:49:23 (2908): No heartbeat from core client for 30 sec - exiting 21:49:24 (2908): No heartbeat from core client for 30 sec - exiting 21:49:25 (2908): No heartbeat from core client for 30 sec - exiting 22:05:35 (6344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:40 (6344): No heartbeat from core client for 30 sec - exiting 22:05:41 (6344): No heartbeat from core client for 30 sec - exiting 22:05:43 (6344): No heartbeat from core client for 30 sec - exiting 22:05:44 (6344): No heartbeat from core client for 30 sec - exiting 22:05:45 (6344): No heartbeat from core client for 30 sec - exiting 22:05:46 (6344): No heartbeat from core client for 30 sec - exiting 22:05:47 (6344): No heartbeat from core client for 30 sec - exiting 22:20:55 (3272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:21:00 (3272): No heartbeat from core client for 30 sec - exiting 22:21:09 (3272): No heartbeat from core client for 30 sec - exiting 22:21:10 (3272): No heartbeat from core client for 30 sec - exiting 22:21:11 (3272): No heartbeat from core client for 30 sec - exiting 22:21:17 (3272): No heartbeat from core client for 30 sec - exiting 22:36:42 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:57 (4544): No heartbeat from core client for 30 sec - exiting 22:37:10 (4544): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:27:14 (1640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:27:19 (1640): No heartbeat from core client for 30 sec - exiting 01:27:20 (1640): No heartbeat from core client for 30 sec - exiting 01:27:21 (1640): No heartbeat from core client for 30 sec - exiting 01:27:22 (1640): No heartbeat from core client for 30 sec - exiting 01:27:24 (1640): No heartbeat from core client for 30 sec - exiting 01:27:25 (1640): No heartbeat from core client for 30 sec - exiting 01:27:26 (1640): No heartbeat from core client for 30 sec - exiting 01:27:28 (1640):01:43:55 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:43:59 (4920): No heartbeat from core client for 30 sec - exiting 01:44:00 (4920): No heartbeat from core client for 30 sec - exiting 01:44:01 (4920): No heartbeat from core client for 30 sec - exiting 01:44:07 (4920): No heartbeat from core client for 30 sec - exiting 01:44:08 (4920): No heartbeat from core client for 30 sec - exiting 01:44:09 (4920): No heartbeat from core client for 30 sec - exiting 01:44:10 (4920): No heartbeat from core client for 30 sec - exiting 02:00:01 (6240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:00:17 (6240): No heartbeat from core client for 30 sec - exiting 02:00:30 (6240): No heartbeat from core client for 30 sec - exiting 02:00:32 (6240): No heartbeat from core client for 30 sec - exiting 02:00:34 (6240): No heartbeat from core client for 30 sec - exiting 02:00:37 (6240): No heartbeat from core client for 30 sec - exiting 02:00:38 (6240): No heartbeat from core client for 30 sec - exiting 02:00:39 (6240): No heartbeat from core client for 30 sec - exiting 02:00:40 (6240): No heartbeat from core client for 30 sec - exiting 02:00:41 (6240): No heartbeat from core client for 30 sec - exiting 02:16:49 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:17:00 (3888): No heartbeat from core client for 30 sec - exiting 02:17:03 (3888): No heartbeat from core client for 30 sec - exiting 02:17:04 (3888): No heartbeat from core client for 30 sec - exiting 02:17:05 (3888): No heartbeat from core client for 30 sec - exiting 02:17:06 (3888): No heartbeat from core client for 30 sec - exiting 02:17:07 (3888): No heartbeat from core client for 30 sec - exiting 02:17:08 (3888): No heartbeat from core client for 30 sec - exiting 02:17:10 (3888): No heartbeat from core client for 30 sec - exiting 02:17:11 (3888): No heartbeat from core client for 30 sec - exiting 02:17:12 (3888): No heartbeat from core client for 30 sec - exiting 02:17:13 (3888): No heartbeat from core client for 30 sec - exiting 02:17:14 (3888):02:33:46 (4208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:33:52 (4208): No heartbeat from core client for 30 sec - exiting 02:33:54 (4208): No heartbeat from core client for 30 sec - exiting 02:33:55 (4208): No heartbeat from core client for 30 sec - exiting 02:33:56 (4208): No heartbeat from core client for 30 sec - exiting 02:33:57 (4208): No heartbeat from core client for 30 sec - exiting 02:33:59 (4208): No heartbeat from core client for 30 sec - exiting 02:34:00 (4208): No heartbeat from core client for 30 sec - exiting 02:34:01 (4208): No heartbeat from core client for 30 sec - exiting 02:50:55 (6820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:50:59 (6820): No heartbeat from core client for 30 sec - exiting 02:51:01 (6820): No heartbeat from core client for 30 sec - exiting 02:51:02 (6820): No heartbeat from core client for 30 sec - exiting 02:51:04 (6820): No heartbeat from core client for 30 sec - exiting 02:51:05 (6820): No heartbeat from core client for 30 sec - exiting 02:51:06 (6820): No heartbeat from core client for 30 sec - exiting 03:07:08 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:12 (4368): No heartbeat from core client for 30 sec - exiting 03:07:13 (4368): No heartbeat from core client for 30 sec - exiting 03:07:14 (4368): No heartbeat from core client for 30 sec - exiting 03:07:15 (4368): No heartbeat from core client for 30 sec - exiting 03:07:16 (4368): No heartbeat from core client for 30 sec - exiting 03:07:17 (4368): No heartbeat from core client for 30 sec - exiting 03:07:18 (4368): No heartbeat from core client for 30 sec - exiting 03:07:19 (4368): No heartbeat from core client for 30 sec - exiting 03:22:50 (2780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:41 (4280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:59 (4280): No heartbeat from core client for 30 sec - exiting 03:40:00 (4280): No heartbeat from core client for 30 sec - exiting 03:40:01 (4280): No heartbeat from core client for 30 sec - exiting 03:40:03 (4280): No heartbeat from core client for 30 sec - exiting 03:40:04 (4280): No heartbeat from core client for 30 sec - exiting 03:40:05 (4280): No heartbeat from core client for 30 sec - exiting 03:40:06 (4280): No heartbeat from core client for 30 sec - exiting 03:40:07 (4280): No heartbeat from core client for 30 sec - exiting 03:56:23 (7088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:13:35 (2292): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 04:13:39 (2292): No heartbeat from core client for 30 sec - exiting 04:13:40 (2292): No heartbeat from core client for 30 sec - exiting 04:13:41 (2292): No heartbeat from core client for 30 sec - exiting 04:13:42 (2292): No heartbeat from core client for 30 sec - exiting 04:13:43 (2292): No heartbeat from core client for 30 sec - exiting 04:13:45 (2292): No heartbeat from core client for 30 sec - exiting 04:13:46 (2292): No heartbeat from core client for 30 sec - exiting 07:30:35 (3296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:30:43 (3296): No heartbeat from core client for 30 sec - exiting 07:30:44 (3296): No heartbeat from core client for 30 sec - exiting 07:30:45 (3296): No heartbeat from core client for 30 sec - exiting 07:30:46 (3296): No heartbeat from core client for 30 sec - exiting 07:30:47 (3296): No heartbeat from core client for 30 sec - exiting 07:30:48 (3296): No heartbeat from core client for 30 sec - exiting 07:30:49 (3296): No heartbeat from core client for 30 sec - exiting 07:30:50 (3296): No heartbeat from core client for 30 sec - exiting 07:30:51 (3296): No heartbeat from core client for 30 sec - exiting 07:30:53 (3296): No heartbeat from core client for 30 sec - exiting 07:30:54 (3296): No heartbeat from core client for 30 sec - exiting 07:30:56 (3296): No heartbeat from core client for 30 sec - exiting 07:30:57 (3296): No heartbeat from core client for 30 sec - exiting 07:30:58 (3296): No heartbeat from core client for 30 sec - exiting 07:30:59 (3296): No heartbeat from core client for 30 sec - exiting 07:46:40 (5156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:49 (5156): No heartbeat from core client for 30 sec - exiting 07:46:50 (5156): No heartbeat from core client for 30 sec - exiting 07:46:56 (5156): No heartbeat from core client for 30 sec - exiting 07:47:03 (5156): No heartbeat from core client for 30 sec - exiting 07:47:05 (5156): No heartbeat from core client for 30 sec - exiting 08:02:58 (1516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:03:07 (1516): No heartbeat from core client for 30 sec - exiting 08:03:11 (1516): No heartbeat from core client for 30 sec - exiting 08:03:12 (1516): No heartbeat from core client for 30 sec - exiting 08:03:13 (1516): No heartbeat from core client for 30 sec - exiting 08:03:14 (1516): No heartbeat from core client for 30 sec - exiting 08:03:15 (1516): No heartbeat from core client for 30 sec - exiting 08:03:16 (1516): No heartbeat from core client for 30 sec - exiting 08:03:17 (1516): No heartbeat from core client for 30 sec - exiting 08:05:56 (2284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:21:58 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:05 (5704): No heartbeat from core client for 30 sec - exiting 08:22:06 (5704): No heartbeat from core client for 30 sec - exiting 08:22:07 (5704): No heartbeat from core client for 30 sec - exiting 08:22:10 (5704): No heartbeat from core client for 30 sec - exiting 08:22:11 (5704): No heartbeat from core client for 30 sec - exiting 08:22:12 (5704): No heartbeat from core client for 30 sec - exiting 08:22:13 (5704): No heartbeat from core client for 30 sec - exiting 08:22:14 (5704): No heartbeat from core client for 30 sec - exiting 08:22:15 (5704): No heartbeat from core client for 30 sec - exiting 08:22:16 (5704): No heartbeat from core client for 30 sec - exiting 08:39:48 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:57 (3440): No heartbeat from core client for 30 sec - exiting 08:40:01 (3440): No heartbeat from core client for 30 sec - exiting 08:40:02 (3440): No heartbeat from core client for 30 sec - exiting 08:40:03 (3440): No heartbeat from core client for 30 sec - exiting 08:40:05 (3440): No heartbeat from core client for 30 sec - exiting 08:40:06 (3440): No heartbeat from core client for 30 sec - exiting 08:40:08 (3440): No heartbeat from core client for 30 sec - exiting 08:40:10 (3440): No heartbeat from core client for 30 sec - exiting 08:40:11 (3440): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:58:16 (3484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:28 (3484): No heartbeat from core client for 30 sec - exiting 08:58:29 (3484): No heartbeat from core client for 30 sec - exiting 08:58:31 (3484): No heartbeat from core client for 30 sec - exiting 08:58:32 (3484): No heartbeat from core client for 30 sec - exiting 08:58:33 (3484): No heartbeat from core client for 30 sec - exiting 08:58:35 (3484): No heartbeat from core client for 30 sec - exiting 08:58:36 (3484): No heartbeat from core client for 30 sec - exiting 08:58:37 (3484): No heartbeat from core client for 30 sec - exiting 08:58:38 (3484): No heartbeat from core client for 30 sec - exiting 08:58:39 (3484): No heartbeat from core client for 30 sec - exiting 08:58:40 (3484): No heartbeat from core client for 30 sec - exiting 08:58:41 (3484): No heartbeat from core client for 30 sec - exiting 08:58:42 (3484): No heartbeat from core client for 30 sec - exiting 08:58:43 (3484): No heartbeat from core client for 30 sec - exiting 08:58:44 (3484): No heartbeat from core client for 30 sec - exiting 09:15:26 (3780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:39 (3780): No heartbeat from core client for 30 sec - exiting 09:15:40 (3780): No heartbeat from core client for 30 sec - exiting 09:15:45 (3780): No heartbeat from core client for 30 sec - exiting 09:15:51 (3780): No heartbeat from core client for 30 sec - exiting 09:16:03 (3780): No heartbeat from core client for 30 sec - exiting 09:32:13 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:32:17 (4652): No heartbeat from core client for 30 sec - exiting 09:32:18 (4652): No heartbeat from core client for 30 sec - exiting 09:32:19 (4652): No heartbeat from core client for 30 sec - exiting 09:32:20 (4652): No heartbeat from core client for 30 sec - exiting 09:32:23 (4652): No heartbeat from core client for 30 sec - exiting 09:32:24 (4652): No heartbeat from core client for 30 sec - exiting 09:32:25 (4652): No heartbeat from core client for 30 sec - exiting 09:32:26 (4652): No heartbeat from core client for 30 sec - exiting 09:32:27 (4652): No heartbeat from core client for 30 sec - exiting 09:32:28 (4652):09:50:06 (1892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:50:11 (1892): No heartbeat from core client for 30 sec - exiting 09:50:12 (1892): No heartbeat from core client for 30 sec - exiting 09:50:13 (1892): No heartbeat from core client for 30 sec - exiting 09:50:29 (1892): No heartbeat from core client for 30 sec - exiting 09:50:37 (1892):Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2928, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish 09:52:30 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3848, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3848, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3848, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3848, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3848, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Dec 2012 14:35:34	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	362,880	437,002	1.2043
15 Dec 2012 13:50:27	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	336,960	397,330	1.1792
14 Dec 2012 16:10:42	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	311,040	366,565	1.1785
14 Dec 2012 16:10:42	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	285,120	336,081	1.1787
14 Dec 2012 16:10:42	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	259,200	305,457	1.1785
14 Dec 2012 16:10:42	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	233,280	274,680	1.1775
14 Dec 2012 16:10:42	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	207,360	244,186	1.1776
14 Dec 2012 16:10:42	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	181,440	214,052	1.1797
14 Dec 2012 16:10:42	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	155,520	183,533	1.1801
14 Dec 2012 16:10:42	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	129,600	153,316	1.1830
07 Dec 2012 19:20:01	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	103,680	122,912	1.1855
07 Dec 2012 06:01:31	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	77,760	92,468	1.1891
06 Dec 2012 14:25:09	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	51,840	61,916	1.1944
06 Dec 2012 03:32:25	1133174	15422149	hadcm3n_ye9j_1980_40_008243580_0	25,920	32,087	1.2379